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MAX-PLUS DECOMPOSITION OF SUPERMARTINGALES 
AND CONVEX ORDER. APPLICATION TO AMERICAN 
OPTIONS AND PORTFOLIO INSURANCE 

By Nicole El Karoui and Asma Meziou 

CMAP, Ecole Poly technique 

We are concerned with a new type of supermartingale decompo- 
sition in the Max-Plus algebra, which essentially consists in express- 
ing any supermartingale of class (I?) as a conditional expectation of 
some running supremum process. As an application, we show how 
the Max-Plus supermartingale decomposition allows, in particular, 
to solve the American optimal stopping problem without having to 
compute the option price. Some illustrative examples based on one- 
dimensional diffusion processes are then provided. Another interest- 
ing application concerns the portfolio insurance. Hence, based on the 
"Max-Plus martingale," we solve in the paper an optimization prob- 
lem whose aim is to find the best martingale dominating a given 
floor process (on every intermediate date), w.r.t. the convex order on 
terminal values. 

1. Introduction. One of the most important decompositions in modern 
probability theory is the Doob-Meyer decomposition of a supermartingale 
Z, into the unique difference of a local martingale M and a predictable 
nondecreasing process A. This additive representation can also be written 
in the form of Zt = E[A(^ — At|-^t] + where C is a stopping time 

defining the horizon of the problem. 

We provide in this paper another "additive" decomposition theorem for 
supermartingales of class (P) , in a nice mathematical structure called Max- 
Plus algebra. This latter is an idempotent semiring structure endowed with 
the two binary operations © = max and (8) = -|-. It introduces a linear algebra 
point of view to dynamic programming problems and large deviations, and 
turns out to be very effective to make algebraic computations (see [6]). 
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Specifically, given a quasi-left-continuous supermartingale Z of class (P), 
defined on [0, C] where C is a stopping time, our aim is to construct an op- 
tional upper-right semi-continuous process L such that Z can be represented 
in terms of the "running supremum" of L: 



Z, = ^ 



sup Lu \J Zc\Tt 
t<u<c 



E 



Ly,®Zc\Tt 



o<t<C- 



Here § denotes a nonlinear integral called Max-Plus integral. The running 
supremum of L over [0,r] for any stopping time r between and C can 
be seen as the value of a nondecreasing process A,- and, hence, the above 
representation is analogous to the Doob-Meyer decomposition. 

The martingale M® defined as the conditional expectation of Z(^ is 
called the martingale of the Max-Plus decomposition of Z and dominates 
At- © Z-T for any stopping time r. We first focus on the martingale uniqueness 
in Section 2 and show that the case is different for the nondecreasing process. 

To establish the existence of such a decomposition, we essentially deal 
with some easy convex duality methods, which turned out to be particularly 
useful for the Bandit problem [19, 45], and for nonlinear representations of 
general processes [7, 15]. 

An interesting application of the Max-Plus decomposition of supermartin- 
gales is the problem of American Call options written on an underlying Y 
of class ("D). In fact, based on the representation of the Snell envelope of Y 
as a conditional expectation of some running supremum -^^^^ = sup^<^<^ L^^ 
we explicitly characterize an optimal stopping time in terms of the index 
process L and, thus, the simple knowledge of L completely solves the opti- 
mal stopping problem without having to compute the price of the American 
option. Moreover, thanks to the Max-Plus decomposition, we get an explicit 
characterization of American Call options as lookback ones. This particu- 
larly generalizes the results of Darling, Liggett and Taylor [10] on American 
options, only valid in the discrete case, where the underlying defines a par- 
tial sum of independent and identically distributed random variables with 
negative drift. Our extension to the case of geometric Levy processes (with 
only negative jumps) leads to an index process L, proportional to the su- 
permartingale underlying. 

Our original interest in the Max-Plus decomposition of supermartingales 
comes from portfolio insurance which is a popular example of dynamic asset 
allocation. In fact, using the Max-Plus decomposition of supermartingales, 
the paper suggests a new approach to the classic utility maximization prob- 
lem with American constraints. The optimization is performed with respect 
to stochastic convex ordering on the terminal value and this avoids arbitrary 
assumptions regarding the form of the utility function of a decision maker. 

To this aim, we first consider a martingale constrained optimization prob- 
lem, in terms of convex ordering. All admissible martingales must have the 
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same initial value and must dominate a given floor process Y. Then we note 
that the martingale of the Max-Plus decomposition of the Snell envelope 
of Y solves the addressed problem. We refer the interested reader to an- 
other paper [20] for more details about the financial application to portfolio 
insurance. 

The paper is organized as follows. In the next section we extend the 
Doob-Meyer decomposition theorem for supermartingales in the Max-Plus 
algebra and use it to generalize in Section 3, the point of view of Darling 
and his co-authors concerning American optimal stopping problems. In Sec- 
tions 3.2 and 3.3 we provide some illustrative examples based on multiplica- 
tive and additive Levy processes, highlighting the link between the Max-Plus 
decomposition and American options. Then, we focus on a parameterized 
problem which allows us to derive an explicit decomposition for a given 
right-continuous supermartingale in the Max-Plus algebra. In Section 4.4 
we apply our Max-Plus decomposition theorem to solve the American Call 
option problem, with a general underlying. In Section 4.5 we reconsider the 
different steps of the Max-Plus decomposition in a Markovian framework. 
Then in Section 5 we show that the martingale involved in this Max-Plus 
decomposition is also characterized as the optimal solution of a particular 
constrained optimization problem, expressed in terms of stochastic convex 
ordering. Finally, we give some closed formulae of martingales involved in 
the Max-Plus decomposition of multiplicative and additive Levy processes. 
We then exploit the Azema-Yor martingale (see [5]) to provide the Max- 
Plus decomposition of any concave increasing function of a continuous local 
martingale. This last example proves to be very insightful and covers, among 
others all the considered cases of Levy processes. The more technical argu- 
ments are relegated to the Appendix. 

2. Supermartingale decompositions. 

2.1. Framework. We here give the notation and definitions which will be 
used throughout the paper. Uncertainty is modeled by some filtered prob- 
ability space {Q,T,P) satisfying the usual conditions, that is, {J^t} is an 
increasing, right-continuous family of u-fields and J-q contains all the P- 
negligible events in J^. We further make the following assumption: 

Assumption 2.1. {^t} is assumed to be quasi-left-continuous, that is 
for any predictable stopping time r, one has J> = J-^- . 

The horizon of the problem is a stopping time denoted by C and may be 
infinite. 

An adapted process X is said to be of class (V) if \X\ is dominated by a 
uniformly integrable martingale. Another characterization of such processes, 
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based on stopping times, is given in Section 4. Note that in the particular 
case where X is a martingale, X is of class (V) if and only if it is uniformly 
integrable, u.i. in short. A supermartingale (martingale) Z of class (P) is 
called a (X')-supermartingale [(P) -martingale]. 

2.2. Supermartingale decompositions. One of the most fundamental de- 
compositions in the theory of stochastic processes is the Doob-Meyer de- 
composition of a supermartingale as the unique difference between a local 
martingale and a predictable nondecreasing process. Recently, motivated by 
optimization problems in Mathematical Finance, such a decomposition has 
been extended to a process defining a supermartingale for an infinite family 
of equivalent probability measures. Nevertheless, El Karoui and Quenez [21], 
and Kramkov [34] have established that this decomposition only holds by 
relaxing the predictability property of the nondecreasing process. In this 
paper, for different reasons, we are also concerned with an optional super- 
martingale decomposition, but with a different meaning. 

Moreover, the additive decomposition is not the only one to present an 
interest. For example, in Mathematical Finance, the multiplicative decompo- 
sition was paid particular attention [30] . We first recall the standard version 
of the Doob-Meyer decomposition theorem [31, 36] and [13], Theorem 4.10, 
page 24. 

Theorem 2.2. Let Z be a (V) -supermartingale defined on [0,C]- 
1. There exists a unique predictable cddldg (right- continuous, left-limited) 
nondecreasing process A such that Aq = 0, Aq integrable, and 



position is unique (up to indistinguishability) . 

3. Further, if Z is quasi-left- continuous, then A is continuous. 

As mentioned above, there exist other decompositions relative to opera- 
tions that are different from addition, such as multiplication [29, 35]. 

Theorem 2.3. Let Z be a positive [T))- supermartingale. 
1. There exists a unique integrable predictable nondecreasing process B 
satisfying Bq = \, such that 




2. In addition, with this representation, we have 




(2.3) 



0<t <C- 



't 



MAX-PLUS DECOMPOSITION OF SUPERMARTINGALES 



5 



2. In addition, with this representation, we have 



(2.4) 



ZtxBt = M 



t ' 



where defined by Mf = E[Sf x Z^lJ't] is a (V) -martingale. This decom- 
position is unique (up to indistinguishability) . 



Note that since the conditional expectation is not hnear w.r.t. multiph- 
cation, we cannot replace, as in the Doob-Meyer decomposition, (2.3) by 



E 



x^{Z^\Tt\. 



Now, we will focus on a new type of decomposition relative to the max 
operation that plays the role of addition in the Max-Plus semifield Mmax^ 
the set of real numbers with the additional point — oo endowed with the 
operations © and ® such that x®y = max(x, y) and x ®y = x + y. 

The problem then is to find an optional process L such that 











= E 


sup Lu\Ti 


= E 






.t<u<(; 







Before that, we first introduce the Max-Plus algebra and describe its basic 
properties. 



2.3. Max-Plus algebra. The Max-Plus framework is important for certain 
problems in discrete mathematics and in computer science applications. 

Definition 2.4 (The algebraic structure Mmax). The symbol Mmax de- 
notes the set MU {— c>o} endowed with the two binary operations = max 
and (8> = + . This algebraic structure Mmax is called the Max-Plus algebra. 



It is an idempotent commutative semifield, that is, the operation © is 
associative, commutative and has 0® = — cxd as zero element. The operation 
® defines a group on M; it is distributive with respect to © and its identity 
element satisfies O9 (8) e,g) = —00 = (8) —00 = —00 = 0®. 

If we compare the properties of © and (8) with those of + and x , we see 
that: 

• we have lost the symmetry of addition [for a given a, an element b does 
not exist such that a © 6 = Oq, or, equivalently, max(6, a) = —00 whenever 

7^ Offi = ~oo], but at the same time, we have gained the idempotency of 
addition: a © a = a; 

• there are no zero divisors in Minax(cK8'6 = 0® = — oo^a = O0 = — cx)or6 = 
Offi = -00). 
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The fact that is idempotent instead of being invertible is the main original 
feature of this "exotic" algebra. This property is sufficient for the simplifi- 
cation of formulae and Mmax is hence a very effective structure to make 
algebraic computations [6]. The simplest example of such computations is 
the resolution of linear equations. 

Example 2.5 (Linear equation). Let us examine the solutions in x of 
(2.5) z®x = 'm. 

Note that the set of solutions can be empty unlike the classic linear equations. 
When it is not empty, the set of solutions has a greatest element x = m. 

Proof. If m < z, then there is no solution. 
If m > z, then x = m. 

If m = z, then any x < z is a solution, but x = m \s the maximal one. □ 

The interested reader is referred to the book by Baccelli, Cohen, Olsder 
and Quadrat [6] and the references therein. It gives a comprehensive account 
of deterministic and stochastic Max-Plus linear discrete event systems, to- 
gether with recent algebraic results (such as symmetrization) . The Max-Plus 
algebra appears to be the right tool to handle synchronization in a linear 
manner, whereas this phenomenon seems to be very nonlinear, or even non- 
smooth, "through the glasses" of conventional algebraic tools. Although the 
initial motivation was essentially found in the study of discrete event sys- 
tems, it turns out that the theory of linear systems on the Max-Plus algebra 
may be appropriate for other purposes too. 

There also exist several excellent survey articles on the subject as the one 
by Gaubert [28], who presents what he believes to be the minimal core of 
Max-Plus results, and illustrates these results by typical applications, at the 
frontier of language theory, control and operations research (performance 
evaluation of discrete event systems, analysis of Markov decision processes 
with average cost). The algebraic structure Mmax introduces a linear algebra 
point of view to dynamic programming problems and large deviations. A 
theory of nonlinear Max-Plus probabilities has been introduced to formalize 
this point of view (see, e.g., [1] by Akian, [2] by Akian, Quadrat and Viot, 
[11] by Del Moral and Doisy), where the Max-Plus probability of an event 
corresponds to the gain of a set of decisions. When the decision space is 
and the gain process a deterministic real function, this nonlinear probability 
is defined as a nonlinear integral: 

Example 2.6 (Max-Plus integral via a running supremum). Let {Itit&ia^c] 
be a real valued function. For any < s < t < ^, the running supremum of / 
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between s and t is by definition a Max-Plus integral on [s,t] w.r.t. I, 
(2.6) /*i= sup fl^ = I+{[s,t[). 

s<u<t Js 

The function t ^ l^^ defined on [s, C] is nondecreasing, right-continuous, pro- 
vided that I is upper-right semi-continuous (u.r.s.c), that is, limsup^no h+e ^ 
If 

The Max-Plus additivity property ly) (/" ly) = §^ ly comes from the 
following relation: 

sup li, V sup ly = sup ly. 

s<v<t t<v<u s<v<u 

The process {Iq j) only increases at points in time s satisfying Ig = Iq g. 

Let f2 be some "sample space," and Q a function defined on with 
negative values and such that sup^_j^^Q{uj) = 0. Then for any Ac^l, the 
Max-Plus probability of A is P^{A) = sup^^^^ Q{uj). Q{io) is called the like- 
lihood of uj, and Q the Max-Plus probability density function. A Max-Plus 
random variable is any ]R]-Qax~v^lu-6d. function Z on 17. TIig IVIax- Plus 6x- 
pectation of Z is E+{Z) = §^ Z{uj) ® P+{dLo) = sup^^<^[Z{uj) + Q{uj)]. Note 
that if E~^(Z) < -l-oo, then Z is Max-Plus integrable. It is also immediate 
that is stable by increasing limit and linear under Max-Plus addition 
and scalar multiplication. 

In the particular case where Q = M"^ and Z{u)) = /]<, (](w) where l^g^t] stands 
for the Max-Plus indicator function which equals if a; €]s,t] and — oo 
otherwise, E~^[Z) comes down to our Max-Plus integral (2.6). 

The theory of the Max-Plus probability calculus has been deeply devel- 
oped by W. H. Fleming who has considered the notion of Max-Plus additive 
integral in his paper [25] . This paper is also concerned with a concept of Max- 
Plus martingale, which is similar to the concept of exponential-maxingale 
as defined in [41]. The results presented there were intended as initial steps 
toward a Max-Plus stochastic calculus (review of some aspects of Max-Plus 
probability, concept of Max-Plus stochastic differential equation and associ- 
ated backward and forward partial differential equations, etc.). 

2.4. Main result. We here give the main theorem of the paper, in a sim- 
ilar form to that of Theorem 2.2. The first part is the Max-Plus version 
of the supermartingale-decomposition, expressed in terms of the running 
supremum of some process L. In contrast with what happens in the additive 
or multiplicative decomposition [equations (2.2) and (2.4)], here the identity 
E[Ar|.Ff] = © At does not hold true at any time t in [0, C]. We just have 
an inequality. 
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We now formulate the main theorem of the paper. The proof of existence 
of a process satisfying the properties below is relegated to Section 4. It is 
established in the case where Z is quasi-left-continuous. Let us first focus 
on the question of uniqueness. 

Theorem 2.7. Let Z he a {'D)-supermartingale defined on [OX], quasi- 
left- continuous and assume that the filtration {J-t} is quasi-left:- continuous. 



1. Z admits the following Max-Plus decomposition: 



(2.7) Zt = E 



sup Lu Z(\Ti 

t<u<( 



E 



/ Lu(BZ(;\J^t 



o<t<c, 



where L = {Lt)o<t<( is an optional upper-right semi- continuous process, 
satisfying L(^< Z(^. 

2. Let he the cddldg running supremum of L^'-L^g = sup«^<^-L„ = 

Define the (V) -martingale M® by 

(2.8) M® := E[LS,^ V Z^\Tt] Vt e [0, (]■ 

(2.9) Then M® > max(Z, .) = Z © ., 
and at any stopping time S <(, 

(2.10) Ls = L*^s^^s=Zs®L*^s = Zs. 

In particular, the following flat-off" condition holds true: 



(2.11) / (Mf -Z,)dLS,. = 0. 

3. This decomposition is unique in the sense of Theorem 2.8 below. 

Partial proof. 1. See Section 4 for the construction of the process L^. 
2. For any time t in [0, ("], by the additivity of L* , we have that 

M® = E[Ll^ V Z^lJ^t] = E[L*^, V Ll^ V Z^\Tt] 

>LS,tVE[L*^VZ^|J-i] = LS,iVZi. 

Moreover, if 5* is a stopping time at which Ls = Lq g, then L^^ = Lq ^ and 
soZs = M®. □ 

The above representation (2.7) provides an additive decomposition for 
supermartingales in the algebraic structure Mmax, analogous to the Doob- 
Meyer's one, but here the nondecreasing process is only optional and not 
necessarily predictable. This restriction is similar to that appearing in the 
Kramkov decomposition [34]. 
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We have also to note that, contrary to what occurs with the Max-Plus de- 
composition, in the preceding decompositions the equality = Zg, where 
is the martingale of the additive Doob-Meyer decomposition (resp. 
Mg = Zs, where is the martingale of the multiplicative decomposition) 
only holds before the first stopping time at which the nondecreasing process 
A (resp. B) increases. 

2.4.1. Uniqueness result. For the uniqueness, we have not to assume a 
priori that the nondecreasing process, involved in the Max-Plus decompo- 
sition, is a running supremum. We only use the "flat-off" condition (2.11). 

Theorem 2.8 (Uniqueness). Let {J^t} be a quasi-left- continuous filtra- 
tion and Z a {T>)-supermartingale. Assume there exists a {T>) -martingale M 
with Mq = Zq, and a cddldg adapted nondecreasing process A taking values 
in [— oo,+oo), such that, almost surely, 

(2.12) Mt >Zt Vt € [0, C], = A<; V Z(;. 

We further assume that A only increases at times t <C when Mt = Zt, that 
is K, satisfies the flat-off condition" 

(2.13) / {Mt-Zt)dAt = a.s. 

Then the martingale M is unique and denoted by M® in the sequel. 

In addition, given such a martingale M® , the set K of the nondecreasing 
processes A satisfying (2.12) and (2.13) has a maximal element, which also 
satisfies condition (2.13). It is denoted by A™^^. 

Remark 2.9. (a) When A is a running supremum Lg ^, A only increases 
when Lqj = Lf. So, the "flat-off condition" implies that condition (2.10) 
holds true. 

(b) At maturity, "the flat-off condition" means that on the subset {A^ > 
A^_£,Ve > 0}, A^ < Z^. This inequality also holds true if A^ > A^, where 
A+ = A<; VZ^. 

(c) Observe that if Z is bounded by below by a real c, M® is also 
bounded by below by c, and the nondecreasing process A © c satisfies con- 
ditions (2.9) and (2.10). 

Remark 2.10 (Dynamic programming). Unlike the other supermartin- 
gale decompositions where, for any stopping time r, the decomposition on 
the time interval [0,C] is also the decomposition on [0,t], here this property 
only holds true if M® = A^. 
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Before establishing the uniqueness result, let us give some examples asso- 
ciated with degenerated supermartingales, first as a decreasing process and 
then as a martingale. 

Example 2.11. (a) Case of a nonincreasing process: if Z is an adapted 
integrable nonincreasing process, then, for each t € [0,^], 

M® = A^^^ = Zo a.s. 

In fact, it can be easily seen that Zq is a martingale that satisfies the Max- 
Plus decomposition. It is also the only one since the martingale involved in 
the decomposition is unique. 

(b) Case of a martingale: if Z is a martingale, then, for each t € [0,^], 

M® = Zt and Af'^^<Zj = E[Z^|^j]. 

Hence, A™*^^ is the greatest cadlag nondecreasing process dominated by Z, 
and defines the conditional infimum of the random variable with respect 
to the fj-algebra Tt: 

^max = essinf{Zj = esssup{yf G J'tlYt < Z^ a.s.} Vt € [0, (]■ 

In fact, for any r G Q, where Q denotes the field of rationals, let us define 
A,^^^ as the conditional infimum of with respect to J-r- The sequence 
(A™^^)reQ is nondecreasing with right-continuous regularization Af^^^. It is 
clear that A™'^^ < E(Z^|.7^t) = Zf. Moreover, if A is a cadlag nondecreasing 
process such that At < A^ < Z^, then At < Af^^. 

Remark 2.12. The conditional infimum is defined in Barron, Cardialaguet 
and Jensen [9]. The concept of maxingale is also introduced, as associated 
with the conditional infimum with respect to a filtration, and used to de- 
velop the new theory of optimal stopping in L°°, as well as the concept of 
an absolutely optimal stopping time. In our case, A™^^ defines a maxingale 
since A™'*^ = Tt — essinfjA™'^-^}, a.s. for each t E [0, Q\. In contrast to martin- 
gales, it turns out that maxingales are easier to analyze since they basically 
always converge. It should be also noted that these processes are different 
from those appearing in the theory of Fleming or Puhalskii [25, 41], since it 
is not the probability Max-Plus which is used here but the usual one. 

The proof of uniqueness is essentially based on the observation that 
is equal to the terminal value A^ of a nondecreasing process. This kind of 
argument was first introduced by El Karoui and Jeanblanc-Picque in [16]. It 
also appears in the papers [17] by El Karoui, Jeanblanc-Picque and Lacoste 
and [7] by Bank and El Karoui. 
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Proof of Theorem 2.8. In the proof, we use the short notation A+ 
introduced in Remark 2.9 for the process A jumping at time such that 
= A(^ V Z^. A"*" still satisfies the flat-off condition. 

Assume that there exists two decompositions {M^ , A~^'^) and (M^jA"*"'^) 
satisfying the previous conditions (2.12) and (2.13). For the sake of simplic- 
ity, we first suppose that A^j"'^ and Aq''^ are finite (note that this assumption 
is automatically satisfied if Z is bounded by below). Then at the end of the 
proof, we will show how this artificial assumption can be relaxed. 

(a) Let / be an arbitrary positive, regular, convex function in C^, null in 
zero [e.g., the C^-bounded regularization of x i— > x"*" on the intervals of the 
form [— e, e] and (— oo, —^] U [i, oo)(e > 0)]. Since /(O) = 0, the convexity of 
/ yields 

f{M^ - Ml) < f'{Ml - mI){MI - Ml) = /'(A+'^ - A+'^)(M^^ - Ml). 

We use the classic differential rule for finite variation processes; it is conve- 
nient to introduce the discrete derivative of /', f'^ as 

/^(x,5) = ^(/'(x + 5)-/'(x)), if 5/0, 
/^(x,0) = r(x), if<5 = 0. 

In the sequel, we set = (A+'i - A+'2) - (A+i^ - A+^^) for s in (0,C]. 
Thus, 

/'(A+'^-A+'^) = /'(A+'^-A+'^) 

+ /^(A+i^ - A+i^ AP) d(A+'i - A+'2). 

Since / is a convex regular function in C^, is positive and bounded. As we 
do not really need the explicit form of f'^, we introduce the short notation 
^'(.):=/-(A+i^-A+i^AP). 

Moreover, note that the current value of the uniformly integrable martin- 
gale M^ — at any time s is nothing else but the conditional expectation 
of its terminal value w.r.t. the filtration Ts, whence 

E[/'(A+'1-A+'2)(m1-M2)] 

= E[/'(A+'^-A+'2)(Mi-M2)] 

/ (Mi-Mf)^'(.)d(A+'i-A+'^ 

In addition, A+'^ (resp. A"*"'^) only increases at times t <C, when Ml = Zt 
(resp. Mf = Zt), whence 

/ {M}-M^)f'J{.s)d{At''-At'') 



+ E 
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f'^{s)iiZs-Ml 



^2)dA+'i-(Mi-Z,)dA+'2)<o. 



Thus, these considerations lead to 



E[/'(A+'^ - A+'2)(M^i - M^)] < E[/'(A, 



A+'')(Mo^-M2)]=0, 



whence E[/(M^ — M^)] < for all convex functions in C^, and the desired 
result follows at once. 

(b) In the case where Aj and Aq are infinite, we just have to set — oo + 
00 = 0. 

(c) Let us consider the set of nondecreasing processes in IC satisfying 



This set is stable by Max-Plus addition. In fact, if = A^ V = A^ V Z^^, 
the same equality holds for A^ V A^ as it has been shown in Example 2.5 on 
the linear equation (2.5) in the Max-Plus algebra. Moreover, since A"*"'^ and 
A"*"'^ only increase at points in time t when M® = Zt, A~^'^ V A"*"'^ satisfies 
the same property. 

The idea now is to introduce the essential supremum of this family of non- 
decreasing processes. To do so, we consider for any r £ Q+, A^ = esssupjA^; A G 
IC}. The family (Ar)^gQ+ is clearly nondecreasing, and for any real t in [0, C), 
we define by Af"^^ = lim^nt A^, the right-regularization of A^. □ 

3. Generalization of Darling Liggett Taylor's point of view on American 
options. Mathematical finance has popularized a particular kind of optimal 
stopping problems, called American options. 

In this section we generalize the ideas of Darling, Liggett and Taylor, 
who considered in their paper [10] American Call options written on partial 
sums Sn of independent and identically distributed random variables with 
negative drift, and characterized optimal stopping times in terms of the 
running supremum of the underlying Sn- 

3.1. Max-Plus decomposition and American Call options. Hence, based 
on a supermartingale representation in terms of a running supremum of 
some index process Lf, we characterize an optimal stopping time in terms 
of L and represent the value function using the running supremum of Bank 
and Follmer that have provided in [8] the same kind of representation based 
on another decomposition (see Remark 3.7). 

Theorem 3.1. Let Z he a supermartingale of class (P) with the fol- 
lowing Max-Plus decomposition in terms of an upper-right semi- continuous 




M® = A+ = A^ V Zc_. 
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process : = E[supj<g<^ VZ^jJ^t] = E[L*^©Z^|^j], where the filtration 
{Ft) is assumed to be quasi-left- continuous. 

The problem to find an optimal stopping time t* (m) to the American Call 
option C^"^{Z,'m) written on Z, and with strike m, 

= esssup,<,<^E[(Z, =E[(Z,.(„,) 

has an explicit universal solution (w.r.t. the strike m>0) given by 

r;(m) = Tt{m) A C := mf{s > t; > m} A C 

(3.1) 

= inf{s >t;Ls>m} A (. 

Moreover, the American Call option C^^{Z,m) is explicitly characterized 
as a lookback one: 



C^"'iZ,m) = E[(L*. V - m)+\Tt] 

(3.2) 



E 



t<s<( 







m 1 





t<c. 



Hence thanks to equation (3.1) which links the optimal stopping time Tt{m) 
to the index process Lj, we do not need to compute the value function 
in order to solve the optimal stopping problem, if we have the Max-Plus 
decomposition of Z. 

The key point is that we can omit the conditioning by J-s in the Max- 
Plus representation of Zs and thus replace Z by L* ^, when computing the 
American Call price. 

Proof of Theorem 3.1. First note that the process (E[(Lj ^ V - 
''^)~^\^t])t&[ox] defines a supermartingale since it is the conditional expec- 
tation of a nonincreasing process. Moreover, since Zs = E[L^^ V Z^|^s] for 
any stopping time S <C, Jensen's inequality implies 

E[{L*s^^ V - m)+|J-s] > (E[L^,^ V Z^l^s] - m)+ = {Zg - m) + , 

for any stopping time «S < C- Thus, the supermartingale (E[(L^ V — 
"^)^l-^t])te[o,C] dominates the process {Zt — m)+, and necessarily its Snell 
envelope C^'^iZ, m) as well. 

Define Tt{m) as the first stopping time after t, at which the process 
m )u>t goes beyond m: 



Tt{7n) ■.= mi{s G [t,C]; LI, > 771}, 



= oo if the set is empty. 
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On the set {Tt{m) < (}, ^Tt(m),c V ^ a^'^' hence, ^Tt(m) = -^[^Tt(m),c 
'^cl-^Tt(?7i)] ^ This yields 



E[(L*^ VZ^- m)+\Tt] = E[E[l{r,i.^)^c}iLT,(mU V " "i)+|^T.Cm)]l-^t] 



where the last equality follows from the fact that Z,^{m) > on the set 
{Tt{m) = 00+}, and since Z^{m) = V m, it comes that < m. 



Hence, E[(L*^ V Z^ - m)+\Tt] = mZr^MAC " m)+\Tt] < Ct'^iZ.m) by 



definition of the Snell envelope. This completes the proof since we have 
already shown the reverse inequality. □ 

Supermartingale processes Z with independent and stationary additive or 
multiplicative increments give us nice examples where the Max-Plus decom- 
position is obvious. We hereafter give some illustrative examples which show 
that we can completely solve the American Call problem with no need to 
the explicit price. We just have to compute the expectation of the running 
supremum of Z, and not its probability distribution. Similar ideas are used 
by Darling, Liggett and Taylor [10] to solve the optimal stopping problem 
in the discrete case. 

3.2. Positive multiplicative Levy processes. Running suprema of Levy 
processes have been, in particular, studied in [4] by Asmussen, Avram and 
Pistorius, who have derived explicit formulae for the pricing of Russian and 
perpetual American put options, under exponential phase- type Levy models. 

Let Z be a positive multiplicative Levy process with initial value x and 
such that E[supq<j<^ Zt] < +00. Since Zq = x, it comes that Zf = xZt, where 
Z is the process that equals Z when Zq = 1. We first assume the maturity 

to be infinite. 

3.2.1. Infinite horizon. Thanks to the independence property of the rel- 
ative increments of Z, we can easily determine a nondecreasing process 
Lq^ = supo<„<tI'n, satisfying the Max-Plus decomposition of Z. Then ap- 
plying Theorem 3.1, we immediately obtain an explicit characterization of an 
optimal stopping time without computing the American Call price. The only 
quantity we need to calculate is xE[sup^>o Zt]~^ = xEIZq ^]~^ = E[^g 
which does not depend on the initial value x. We assume in the following 
proposition that {J-t) is a quasi- left-continuous filtration. 




E[l{Tt{m)<C}(^Tt{m) " 



cl.S. , 
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Proposition 3.2. Let Z he a positive multiplicative Levy process defin- 
ing a supermartingale with initial value x and such that E[supo<t<oo ^t] < 
+00. Then using the notation Z^ := = supQ<„<jZ„, we get: 



1 



1. Zt = 6E[Z; |J"t] and L*Qt = bZ; where b= . 

2. An exercise boundary to the perpetual American Call option C^"^{Z,m) 
is given by E^{m) = mE[^g and the corresponding optimal stopping 
time is explicitly characterized by 

Tt{m) = inf{s > t; bZs >m} = mf{s > t; > mB[Zl^]}. 

Proof. 1. We use the previous notation Z*^ = supg<^.^^^ Z^. Thanks to 
the independence of relative increments and the integrabihty property of 



Z 



O.oo? 



we have that 



(3.3) Z. = 6E|Z;„|jr,], 



l = iE 



supZ„ 



since 



nz*\j-t]=ztB 



X I0<u 
Zu 



■■E\Z, 



O.ooJ 



Lt = bZt 



sup 

t<u 



Z,E 



sup 

.0< 



i:(%f) 



Z,B 



sup Zu 

.0<u 



□ 



We also note that, in light of Theorem 3.1, a perpetual American Call 
written on Z with strike m is nothing else but a perpetual lookback option 
written on the index process L and with the same strike m: 



(3.4) C^^{Z,m,)=E[{bZ*o, 



m] 



^0,00 



E[^o*.c 



Remark 3.3. When the time horizon is finite and denoted by T, the 
constant b in the Max-Plus decomposition of Z is replaced by a function b{-) 
such that, at any time t, 



sup h{T -u)Zu\J^t 

t<u<T 



Zt = E 

However, we do not have an explicit formula for the function b(-). 



Let us give some examples of positive multiplicative Levy processes Z 
for which the corresponding perpetual American Call option can be solved 
explicitly. Since we only need to know the exercise boundary, the follow- 
ing examples come down to calculate the expectation of the maximum of 
Z. We start with the geometric Brownian motion motivated by financial 
applications. 
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Examples of calculations of the expectation of the maximum Geometric 
Brownian motion. Let us consider a geometric Brownian motion with neg- 
ative drift (r > 0) and positive initial value, so as to be a supermartingale: 

dZ 

-—L = -rdt + adWu Zo = x>0. 

Set 7 = 1 + It is well known that P[Zo% > m] = A 1)^ E[Zo%] = ^x 
and, thus, E[2^qj^] = This classic result is proven in Section 5. 

Geometric Levy process. The same decomposition holds for a jumping 
geometric Levy process Z that defines a supermartingale. However, we have 
to introduce other assumptions so as to satisfy the condition E[Zqoo] < oo. 
We follow hereafter the notation of Mordecki in his paper [38] . 

Let us consider the particular case where the horizon is infinite and Zt = 
xe^^ , where X defines an upper semi-continuous process, or equivalently, a 
Levy process with no positive jumps: 

i/ia - idV^ + / (e'^^ - 1 - i/iyl{_i<j/<o})n(dy)] 1, 

J— oo J J 

with a and o" > two real constants, and H a positive measure supported 
on the set (— oo,0) such that /(I Ay^)n(dy) < +oo. The Laplace exponent 
is defined for A > by 

K{\) = aX + \a^X^+ f (e^?^-l-A2/l{_i<j,<o})n(dy), 

J — oo 

and satisfies E(e^''^') = e^'^^'^\ We also assume that the process e^^e"^^ defines 
a martingale, which implies that E[e"'''*] = e~^*, that is, k(1) = — r. 

Since «;(0) = 0, k is convex and limA-^+oo '^(A) = -|-oo, there exists 7Levy > 
1 such that K(7Lcvy) = 0. Hence, in light of the paper [38], we deduce that 

E[^o oo] = ^^"^^ 1 where 7Lcvy > 1 is such that K(7Lcvy) = 0. 

TLevy - 1 

Closed formulae. Numerically, thanks to equation (3.4), we can compute 
the price of the perpetual American Call Cq"^{Z, m) with simply two Monte- 
Carlo simulations, one for E[2ooo] the other for the whole expectation. 
We just have to check beforehand that E[Zqj^] < -|-cxd. 

However, in many cases of Levy processes, these expectations are easy to 
calculate and can be got in an explicit form. For example, the next proposi- 
tion gives the explicit expression of C^™(Z', m) in the case where Z evolves 
according to a geometric Brownian motion, but since this price is needless 
to solve the optimal stopping problem, we relegate the proof to Section 5. 



Ee' 



iliXt 



■ exp < t 
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Proposition 3.4. Let us assume the filtration {Tt) to he quasi-left- 
continuous and consider a geometric Brownian motion Z with parameters 
{—r,a). The price of the American Call option written on the underlying Z, 
with strike m is given by 



Ct^{Z,m) 



E 



7-1 

7 



Z\ 




t,oo 



1-7 



m 



7-1 



7 

otherwise. 



Zt < m, 



American Put options. Note that the American Call option C^"^{Z,m) 
with no discount factor comes down to a "classic" American Put by a simple 
change of probability measure. 

In fact, using the martingale property of the positive continuous process 
e^*Zf, we define a new equivalent probability measure on J^t by its 
Radon-Nikodym density with respect to P: 



dQ^ 



dP 



-,Z^ 



Then taking xZ~^ as a new numeraire, we transform our American Call 
option into a classic American Put option with new underlying mxZ~^ and 
new strike x: 



C^-^{Z,m) 



(3.5) 



:supEp[(Z^ -m)+] 

T 

■ sup Eqz [xe'~'^'^ Z^^{Zr 

T 

■ sup Eqz [e"^"^ {x — mx 



m] 



Zr'Y\ 



= m2;Put^°'(x~\m"^). 

Observe that the new underlying Z~^ defines a submartingale under the 
probability measure Q'^ and evolves according to a positive multiplicative 
Levy process. Moreover, the exercise boundary E^^m"^) of this new "classic" 
Put option is nothing else but the inverse of E'^{m), that is, EP{m~^) = 



7-1 



m 



This Put-Call duality formula (3.5), based on an adequate change of prob- 
ability measure, can be more generally extended to one-dimensional time ho- 
mogeneous diffusion processes with a volatility function. However, the two 
"dual" underlyings will not necessarily have the same dynamics any more. 
We refer the reader to [24] for more details about the duality between prices 
of Put and Call options. 
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In the case where Z = xe * , where X defines a Levy process with no 
positive jumps, it can be shown that, by an adequate change of probabihty, 
m) is nothing else but the price of a perpetual Put option, written 
on the underlying asset me~'^* and with a strike K = x. Based on [38], we 
deduce a closed formula for C^"^{Z,m) as a function of Zf. This function is 
the same as in Proposition 3.4, but with the parameter 7Levy 



3.2.2. Independent exponential r.v. horizon. Assume now that the time 
horizon defines an independent exponential r.v. with parameter (3 > 0. Let 
Gt be the right-continuous augmented filtration generated by J-'tA(; V(j(t AC)- 
Then one can observe that, on the set {t < ("}, any t/^-measurable r.v. on 
O X M"^ is also .T^^-measurable. So, for any r.v. X £G(^, 

(3.6) E[X|g,]l|,<^| = ^i,^^^^<^|^*^ lft<^| = e^*E[Xl|,<^}|.F,]lft<c}- 

In order to derive an explicit decomposition of Z in the Max-Plus algebra 

relative to the ^-filtration, we first observe that, on the set {t < C}, -zf' is 

conditionally independent of Zt given Qt and has the same distribution as 

z* 

— ^ We hence obtain 



X 



^tl{t<C} = E 



Zt 



Tt 



(3.7) 

= hpnzi(^\Qt\\t<Q 



where ^ = E[^] = E[Z*^]. Note here that E[Z*jgt] = E[Z*^_|gt], and 
thus, Zj*^ = Z*^_ a.s. 

The previous representation (3.7) cannot be considered as a Max-Plus 
decomposition of Z since it only holds for t <(,. To obtain such a decompo- 
sition in this case, we must rather consider the filtration Qt instead of Tt and 
introduce the following process Zt = Ztl^t^^^y = ZtA( — Z^l{(^<j}. Thanks to 
the positivity of Z, Z is clearly a ^t-supermartingale, as it is the difference 
between a supermartingale and a nonincreasing process. Let us also observe 
that Z(^ = 0, which leads to the same properties as the previous case. More- 
over, the positivity properties of Z imply that, for t < C, 

Zt(-= sup Zu= sup Zu= sup {Zul{u<c})= sup Zu= sup Zu = Zt^. 

t<u<( t<u<( t<u<( t<u<C t<u<C 

Observe that, for t = (, supt<u<Q Zu = Z(^^ ^'^Vt<u<c, Zu = Z(^= 0. 
We hence obtain the following Max-Plus decomposition of Z: 
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Lemma 3.5. Let Zt = Ztl^f^Q and hp = Then for any t<C,, 

% = hp¥.[Zl^\Qt]l{t^^^ = bpnZlc\^t] and = b^Z^ = bpZ; . 

Then the results of Proposition 3.2 can be extended to the exponential 
horizon time and remain the same. We just have to replace Z hy Z, bhy bp 
and the filtration by Gt- 

Example 3.6 (Geometric Brownian motion). We show in Section 5 that 
if Z defines a geometric Brownian motion with parameters (— r, a),bp = 

where 6 is the root greater than 7 = 1 + of the equation y'^ — jy — ^ = 0. 

Remark 3.7. Equation (3.7) leads to the following representation of Z 
on the set {t < ("}: 



(3.8) Zt = 

0/3 



/ + 00 
(3e-^(.'-'^Zl,ds\Tt 



Let /i be a nonnegative optional random measure and let / = f{uj, t,x):i} x 
[0, +00] X M — > M be a random field with the following properties: 

1. For any x € M, the mapping {uj,t) f{u!,t,x) defines a progressively 
measurable process in L^{P{dLo) (g) fi{uj,dt)). 

2. For any (u;,t) € x [0, -|-cxd], the mapping x 1— /(u;,t,x) is continuous 
and strictly decreasing from +00 to —00. 

Then, for any given optional process X = {Xt)te[o,+oo] with X^oo = 0, 
Bank and El Karoui have constructed in [7] a progressively measurable pro- 
cess ^ = i(,u)ue[o,+oo) with upper-right continuous paths such that 



f[s, sup (,u)'i-{t,+oc]{s)^L'^(P'S)fJ.ids)) 



and 

Xt = E 



/ fis, sup Ci,] fi{ds)\J^t 

J{t,+oo] \ ue[t,s) J 



for any stopping time t G T. This stochastic representation of X in terms of 
running suprema of ^ comes down to equation (3.8), in the particular case 
where Xt = Zfe"^*, ^ = ^ and /(s,0 = ^e'f^n. 



3.3. Additive Levy processes. Let Z define a supermartingale with inde- 
pendent additive increments and initial value x, such that £[^9^,^] < +00. 
Let Z be the process Z starting from Q: Zt = Zt — x. We assume the maturity 
C, to be infinite. 
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Using the same notation as before and setting b = E[supo<u^u] — x = 
E[Zq — X = E[Zq qq], it can be easily seen that Zt takes the simple form of 
Zt = 'E[Z^^ — h\J^t\-, thanks to the independence property of the increments 
of Z. Then we need only to compute the expectation E[^ooo] s-'^d apply 
Theorem 3.1 to solve the American Call problem. The value function is still 
useless in this case. 

Proposition 3.8. Let (J-t) be a quasi-left- continuous filtration, and Z 
an additive Levy process defining a supermartingale with initial value x, and 
such that E[Zqqq] < +cx). Then: 

1. Zt = E[Zj% - b\Tt] and lJ'/ = Z^ - b, where b = E[Z^^^] . 

2. An optimal stopping time to the perpetual American Call option C^'^iZ, m), 
where S is a stopping time, is explicitly characterized by 

r|(m) = inf{t >S;Zt-b>m} = mi{t >S;Zt>m + B[Z^^^]}, 

and the exercise boundary is hence given by E'^{m) = m + E[ZQ^]. 

3. The price at time t of the perpetual American Call C^™{Z,m) is given 
by 

Ct'\Z,m) = E[(Z,% - E[Zo*,oo] - m)+\Tt]. 

Example 3.9 (Brownian motion). Let us consider a Brownian motion 
with negative drift, defining a supermartingale Z: 

(3.9) dZt = -^ldt + adWt,ZQ = Q, fi>0, 

and set 7 = The law of ^0,00 be deduced from the example of the 
Geometric Brownian motion and we get 6= i. We can also derive a closed 
formula of C/^™(Z, m) as a function of Z^. 

4. Existence of the supermartingale decomposition in the Max-Plus alge- 
bra. In the present section our purpose is to establish the existence of the 
preceding decomposition in the Max-Plus algebra. To do so, convex duality 
methods can be used with great efficiency. In our context, it was Whittle 
(see [45]) who first introduced a convex family of optimal stopping prob- 
lems, in order to solve the Bandit problem. Since then, the same idea has 
been exploited by other authors. El Karoui-Karatzas for the Bandit problem 
[19], or by Bank-El Karoui [7] or El Karoui-Follmer [15] to obtain nonlinear 
representation of general processes (see Remark 3.7 and Section 4.5). 
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4.1. Review of the main results on optimal stopping problems. In general, 
each process X that we consider in the paper is defined on [0, C] and assumed 
to be adapted and cadlag. As usual, a stopping time can take infinite values. 
To avoid any confusion with the horizon we use the notation 00+ when it 
is infinite. By convention, all processes are null at this time. The family of 
all stopping times (finite or not) is denoted by T and for any stopping time 
S, Ts is the set of stopping times posterior to S :Ts = {t > S;t £ T}. 

The adapted processes such that the family {^rAclreT is uniformly in- 
tegrable are of class (P). [A useful criterion to show uniform integrability is 
the La Vallee-Poussin criterion (see [23] for further details). It states that 
if there exists a positive, nondecreasing, convex function (p{t) defined on 

[0,00) such that limt^oo = +00 and sup^g7-E(0o \Xr\) < 00, then X 
is uniformly integrable.] This property is in fact a necessary and sufficient 
condition for a process X to be of class (P), and it is then equivalent to the 
characterization given in Section 2 (see [31]). 

As we shall essentially work with stopping times, the following criteria 
are very useful to show the path regularity ([13], Theorem 48-49, page 120): 

• An optional process X of class (P) is right-continuous {X = X~^) if and 
only if E[Xt-„1t-„<oo+] ^ E[Xt-1^<;oo+], for every nonincreasing sequence 
of stopping times (Tn)n>o ^ with r = limn^oo Tn a.s. 

• For the left-hand regularity, we need to be more precise. A process X of 
class {V) is said to be quasi-left-continuous if E[XT-„lo<r„<oo+] tends to 
E[XrlQ^r<oo+]j foi' every increasing sequence of stopping times (t„)„>o, 
tending toward r almost surely, r is said to be predictable. 

Then, X is left-limited (with process of left limits X~) and E[X~1^<cxd+] = 
E[Xt-1,-<oo+] for any predictable stopping time r. Despite this equal- 
ity, in general, X~ 7^ X and, hence, X is not left-continuous. The main 
reason is that X~ is predictable and X optional. The difficulty disap- 
pears by introducing the predictable projection X^^^ of X, characterized 
by the identity xi'^'^l^^^^+y = 'E{XT-\T^-)l^r<oo+}^ ^or any predictable 

stopping time r. So E[X^-1^^^+] =E[X^'^^1^^^+] = E[Xrlr<oo+]^ and 
both predictable processes X- and are indistinguishable (cf. [13] by 
Dellacherie-Meyer) . 

In what follows, a quasi-left-continuous process X belonging to the class 
Xt> [of cadlag processes of class (P)] is said to be (T>)-regular. 

• All martingales of class (P) are regular. 

• Any predictable nondecreasing process A associated with the Doob- 
Meyer decomposition of a regular supermartingale Z is continuous since 
it satisfies the following identity, E[^,-1^.^oq+] =E[A^-1^^^+] for any 
predictable stopping time r. 

Let us state a lemma, which will be useful in the sequel, on the convex 
transformation of quasi-left-continuous processes. 



22 



N. EL KAROUI AND A. MEZIOU 



Lemma 4.1. If X = X^p\ then, for any continuous convex function ip, 
we have that (p{X~) < ip{X)^P\ In particular, for any real m, X~ V m < 
(X Vm)(p). 

Proof. For any predictable stopping time r, we have that 
E[(/,(X,-)1,<^+] =E[v,(X(P))l,<^+] =E[(/,(E[X.|.;^,.])1,<^+] 
<E[E[(^(X,)|.F,-]l,<^+] = E[(^(X.)(P)l,<^+], 
where the inequahty follows from the convex property of ip. □ 

4.2. A convex family of supermartingales. Let Z = {Zf, t£[0,C,]) be a 
(I')-regular supermartingale. We hence introduce the Snell envelope Z, (m) = 
{Zt{m);t G [0, C]) of Z V m = {Zt V m;t € [0, C])i that is, the smallest cadlag 
supermartingale dominating Z V m, indexed by the real parameter m, and 
study the properties of this supermartingale family as a function of the 
parameter m. The key property is the convexity w.r. to m of this random 
field. 

The dual characterization of Z.{m) is well known: for any stopping time 
S S Tq^^, Zs{m) is in the form of 

(4.1) =esssupE[Z^ VmlJ^s], 

where Ts^( denotes the collection of ^-stopping times with values in [S, C] ■ 
The following observations are useful: 

• If Z is a martingale M, then M V m is a submartingale and it is never 
optimal to stop before maturity. Thus, M.{m) is a martingale, and 

(4.2) Msim) = E[M^ V ml^s]. 

• When Z is a (P)-regular supermartingale and thus of the class (P), there 
exist two u.i. martingales U and V, such that U < Z <V; then the Snell 
envelope Z.{m) belongs to the class {T>), and E[[/^ V m\Ts] < Zs{m) < 
B[V(;ym\Ts]- 

The main properties of {Zs{m))seTo ^ essentially lie on properties related 
to the Snell envelope and optimal stopping theory. The following proposition 
precises the regularities of this parameterized family of supermartingales 
with respect to the parameter m. 

Proposition 4.2. 1. There exists a 1-Lipschitzian regular version of 
the random field {S,m) i— > Zs{m), such that m Zs{m) is convex and non- 
decreasing and m ^ Zs{m) —m is convex, nonincreasing. Moreover, for any 
Ts -measurable r.v. As, 

Zs{As) = esssupE[Z, V Asl^s], t e T^,^. 

s<T<(; 
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2. The boundary m is absorbing for the process Z.{m). In particular, if 
es{m):=mi{te[SX]\Zt{m) = m}, (= (X)+ if{-} = 0), 
then, on the set {6t{m) < (}, Zu{m) = m for all U € [9t{m)^C,]. 

Proof. 1. The proof of the first item is technical and relegated to the 
Appendix. 

2. It is a classic property of nonnegative supermartingales that is ab- 
sorbing. Applying this result to the nonnegative supermartingale Z.{m) — m, 
we obtain the desired result. The same property holds when m is replaced 
by an .T^^-measurable r.v. A5. □ 

4.2.1. Optimal stopping times. In this section we briefly outline some 
basic facts concerning the optimal stopping theory without proof (see [14] 
and [32] for more general treatments), and especially the links between the 
Snell envelope and optimal stopping times. We directly express these results 
in terms of the process Z.{m). The filtration (Tt) is assumed to be quasi- 
left-continuous in the following theorem. 

Theorem 4.3. Assume Z to be a {T))-regular supermartingale. Then: 

1. Z.{m) is a {T>) -regular supermartingale. 

2. Moreover, let Ts{m) := inf{i € [S,C];Zt{m) = Zt},= oo~^ if the set is 
empty. 

The stopping time Ts{m) A C is an optimal stopping time: 
Zs{m)='E[sup{Zrp^^^);,^,m)\Ts] and Zj^g(„,);\f (m) = sup(Zrg(^)^^, m), 

but the smallest optimal stopping time is Ts{m) ■.= Ts{in) A0s{iti). 

3. The family m 1— > Ts{m) is nondecreasing and left- continuous. 

Remark 4.4. The proof of the left- continuity of the family m Ts{m) A 
is the most technical part of the work. It can be omitted in a first reading. 

Proof of Theorem 4.3. 1. If the supermartingale Z is continuous (in 
the case of a Brownian filtration, e.g.), the process ZVm is also continuous, 
and the classic theory may be applied to explain the first part of the theorem 
(see [19]). In the general case where Z is only quasi-left-continuous, the 
process Z V m is only upper-quasi-left-continuous, since from Lemma 4.1, 
Z^ V m < {Z y myP^. Equivalently and in terms of stopping times, for any 
increasing sequence of stopping times Sn T 'S', hnin^oo E[Z5^ V m] < E[Zs V 
m] (cf. the second preliminary remark). To conclude, we have to use general 
results on optimal stopping problems; in particular, the desired result follows 
immediately from [14], Theorem 2.43, page 142. 
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2. We first observe that 

■2'Ts(m) AC = ^Ts(m.)("^)l{Ts{m)<C} + SUp(Zc' "^)l{Ts(m)=oo+} 
= ^Ts(m)l{Ts{m)<C} + SUpC^^, m) l^^-g (m)=oo+ } ■ 

But on {Ts{m) < C}, ZTs(m){rn) = ZTs{m) > ^ and so 
It remains to observe that 

%s(m)("^) = ZBs{m)A{Ts{m) AO (.m) 

= SUp(Z5"g(m)AC''^)l{Ts(m)AC<6'sM} + "^l{6»sM<Ts MAC} • 

Then since m is absorbing on the set {0s(m) < Ts{m) A C}, ■^Ts(m)Ac("^) ~ 
m = sup(ZTg(„)A^, m). So we finahy obtain that Z^^^^^ (m) = Zxg[rn)AC,{f^) — 

sup(ZTs(m)AC>'^)- 

3. Let e > 0. Since jtt, i-^' Zu{m) is Lipschitz continuous at any time U > S, 
Zu{m — e) ^ Zi/{m) a.s. and in L^, as e J, 0. 

Let us set Tg := Ts{m — e), Ts := Ts{m) and T5- := lim | Ts{m — e). We 

(p) 

specify the predictable part Tg_ of T^- as the stopping time defined by 

T^^J = Ts- on //^^ = {cu, r| TT Ts- }, = 00+ if not, 

T^;} = Ts- on {H^J = {uj,3eTI = Ts-}, = 00+ if not. 

So Ts~ = mi{T^} ,T^^}). We can give a precise description of the limit of the 
different terms: 

(a) on {H:^^Y, limZT|Ac("T'-e) = ^t^-acM^ and if T5- < C, then r| < 
C and .^r|AC ~ tends to Zj'^_ ■ If Tg- = oo"*", then there exists e such that 
T| = 00+ and Zt'|ac("^~^) ~ sup(Z^,m — e). So in both cases, .^Tg_Ac("^) = 
sup(Z2-^_/\^, m). We easily deduce that Ts-{m) = Ts{m) on [H^^y. 

(b) on H^^ , thanks to the strict monotonicity of the sequence T| , T^} < 
(, and lim^^o -^T^Acl™- ~ = Z~{p) ("^)- other hand, ZT^{m — e) = 

since T| < C a.s., whence hm.^o Z^Aci^ - e) = lim,^o = • 

s- 

Since is predictable on Hj,^, and thanks to the quasi-left-continuity of 
Z and Z.(m), this yields 

^-(rt (m) = Z^^l, (m) = Z- = Z^^l = E[Z^(,) j.^-^,, ] . 

s- s- s- s~ s s- 

Then on ^^-f^, Z^(p){m) = Z^(p) a.s. and T^] = Ts- = Ts{m), since Ts{m) 

s- s- 

is the smallest stopping time U after S satisfying Z]j{m) = Zjj. □ 
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Remark 4.5. If the supermartingale Z is not quasi-left-continuous, it 
has been shown in [14] that we can find an optimality loss in the optimal 
stopping problem of the process Z \J m; more precisely, the candidate to be 
an optimal stopping time is the time fs{m) such that 

Ts{m) := inf{i > S; Zt{m) = ZfV m or Z^(m) = Z^ V m} A C- 

It is possible to adapt the previous proof by introducing the two families of 
stopping times Os{m) = inf{t > S; Zt{m) = m or Zf{m) = m} and Ts{m) = 
inf{t > S\ Zt{m) = Zf or Z^{m) = Z^}. 

4.3. Convex analysis and characterization of the Z-Max-Plus decomposi- 
tion. In what follows, we assume Z to be a (D)-regular supermartingale. 
We are still working with the 1-Lipschitzian version of the random field 
m I— > Z.{m). Thanks to the convexity and monotonicity of m i-^ Z. V m, the 
random field Z.(m) inherits the same properties. In particular, it is possible 
to characterize the left-hand derivative of Zs{m) w.r.t. m. 

Similar ideas can be found in the paper by El Karoui and Karatzas [19]. 
By considering some properties (w.r.t. K) of a convex family of American 
Put options, they have provided a representation of the early exercise pre- 
mium of an American put-option with given strike-price X > 0, on a finite 
time-horizon. The main difference in our context is that the asset process is a 
supermartingale which is not required to be continuous, but only continuous 
in expectation with respect to stopping times. Also very closed to this point 
of view is the representation theorem of any process X of class (P) estab- 
lished by Bank and El Karoui [7]. We assume in the following proposition 
that the filtration {Tt) is quasi- left-continuous. 

Proposition 4.6 [Static representation of Zt{m)]. Fix S in Tq^q and let 
A5(a) he the left-inverse at time a of the mapping m i— > Ts{m), where m G 
M.- h.s{oi) := s\i\i{m\Ts{m) < a}, with the conventional notation sup{0} = 
—oo. 

(a) The convex mapping m i— s- Zs{m) has a left-hand derivative satisfying 
^Zs{m) = P[Z^ < m- Ts{m) = cx)+|^5] 

(4.3) 

= P[Zc < m- KsiO < m\^s] = 1 + ^C^"'{Z,m) a.s. 

(b) For all reals m, 

Zsim)=B[As{C)'^Z^Vm\J^s] and Zs = Zs{-oo) =E[As{C) V Z^\Ts]- 

This result is strongly related to "traditional envelope theorems" which 
describe sufficient conditions for the value of a parameterized optimization 
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problem to be differentiable in the parameter and provide a formula for the 
derivative. See [37] for a review of envelope theorems. 

Proof of Proposition 4.6. (a) The proof is based on the optimality 
of Ts (m) A C and on the classic convex inequalities 

el{x<m-e} <xVm-xV(m-e)< el{^^.m}. 
The set {Zj'g(„^)/\^ < ni} plays a key role. Since on {Ts{m) < (}, Z'j^^(^,^-^ = 

{^Ts(m)AC <m} = {Z^ < m-Ts{m) = 00+}. 
These observations yield to the following series of inequalities: 

Zs{m) - Zs{m - e) < E[sup(Zr<,(„)^^, m) - sup(Zrg(m)AC, - e)|-^s] 
<eP[Zi^<m-Ts{m) = ^+\Ts]. 
Now to obtain a lower bound, we apply the optimality to Ts{m — e) AC- 

Zs{m) - Zs{m - e) > E[snp{ZTs(m~e)AC^'^) ~ sup(^Ts(m-e)AC, - 

> eP[Z<^ <m- e;Ts{m - e) = oo+|J^s]- 
Since the sequence Ts^m) is nondecreasing and left-continuous, 
limPfZ^ < m — e;Ts(m — e) = 00^ \J^s] 

(4.4) 

<P[Z^ <m;Ts{m) = (^+\Ts]- 

However, {Ts{m) = 00+} = f]^{Ts{m — e) = cxo"*"} since, on H^^^, Ts{m) = 
lim T5(m — e) <C,. The inequality in (4.4) is therefore an equality and we 
finally obtain 

Q- 

— — Zsim) = limPfZ^ < m — e;Ts(in — e) = oo'^lJ^s] 
dm ej,o ^ 

= P[Z^ <m;Ts{m) = 00+ \Ts]- 

(b) Now, we would like to reintegrate in order to derive an explicit repre- 
sentation of Zs{m). To do so, we need to express the event {Ts{m) = oo~^} 
according to m in a simpler way. Note that {m;Ts{m) < C} is an interval 
closed on the right by As{C)j also defined by 

A5(C)=sup{m;T5(m)<C}, (=-00 if {•} = 0). 

It follows that ^:^Zs{m) = P[.^f <m;m> As{C)\J-'s]- Then we need some 
boundary conditions. Since Zs{m) — m = esssup^g^-^ ^ E[(Zt- — m)^\J^s], we 
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can use (4.2) to show that if Z is dominated by the uniformly integrable 
martingale 

0< lim {Zs{m)-m)< lim E[(V> - m)+|J^5] = 

mf+oo mf+oo 

and we can hence write 

Zs{m)—m= / — — {Zs{a)—a)da. 
Jm oa 

Note that we cannot directly reintegrate ^Zs{m), since the limit of Zs{m) 
when m goes to — oo is equal to Zs and thus unknown. Then, the following 
equality can be deduced from (4.3): 

f + OO 

Zs{m) -m= P[As{C) yZ^> a\J^s] da. 

J m 

Applying the conditional Fubini theorem, we hence obtain 
Zs(m) -m = E[(A5(C) V - m)+\Ts] 

and 

Zs{m) = ^[Ks{C)y Zi^\J m\Ts]. 

(c) Now letting m J, — oo and applying the monotonous convergence the- 
orem, we get limmj-oo Zs{m) = Zs{—oo) = Ei[As{C) V Z(^\J^s]- On the other 
hand, the sequence Ts{m) is decreasing to Tg{—oo) and by the right- 
continuity of Z, Z'irg(^)/\^ Vm goes to ^r+(_oo)AC' Lebesgue theorem, 

Zs< lim Zs{m)= lim E[sup(Zt („)^A,m)|J^5] 

ml—oo ml—oo 

= 'E[Zrpg(-oo)+ m:\^s\ < Zs, a.s., 

since Ts{—oo)~^ A C is a stopping time posterior to S and Z a supermartin- 
gale. It finally follows that Zs = Zs{-oo) = E[A5(C) V Z^|J^s]. □ 

The preceding proposition provides a static representation of Zt{m) {t 
fixed) . We shall hereafter exploit the dynamic structure of the Snell envelope 
{Zt{m);t > 0} in order to deduce a representation which exhibits the depen- 
dence of At{C) w.r.t. t. To do that, we use techniques related to change of 
variable in M, that we recall in the following lemma: 

Lemma 4.7. Set 

Aj(a) := sup{m;T((m) < q}; a G [t, ("], = — oo if the set is empty. 

Then At{a) defines the right- continuous inverse of the nondecreasing, left- 
continuous mapping m^Tt{m). In other terms, 

Tt{m)<a m<Kt{a) Vae[t,C]. 
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Note that since the inequahties are large, At (a) represents the right-hand 
inverse of the left-continuous process m i— > Tt{m). Previous works on time 
changes [22] have shown that the process a i— > At{a) is right-continuous. Let 
us stress that we are not in the usual cases, where we rather consider right- 
hand inverses of right-continuous processes, and where the inequalities are 
consequently strict. The interested reader can, for example, refer to [22] for 
full details on time change theory. 

Now, the following theorem represents the increasing process {At{a);t < 
a <C} in terms of a running supremum process and gives an explicit form 
of the martingale M® of the Max-Plus decomposition of Z. 

Theorem 4.8. Assume that the filtration {Tt) is quasi-left- continuous, 
and let Lt be the J^t-measurahle r.v. defined by 

Lt : = sup{m G Q; Zt{m) = Zt} 

= sup{m € Q;Tj(m) = t}, = —oo if the set is empty. 

Let ^ be the running supremum of L over [t, a] {t <a <Q, that is, ^ = 
s^Vt<s<aLs. Then: 

(a) L*„ = At(Q) for any a € [t,C] and, hence, Zt{m) = E[L*^ V Zq V 
m\J^t], and L^^ is right- continuous for any a G [t, C[- 

(b) The process {Mt)t>o defined by 

Mt = E[Ll^ V Z^\:Ft] = Zt{Llt) >Zt = Zt{-oo), < t < C, 

is the martingale M® of the Max-Plus decomposition of Z since the increas- 
ing process (Lg J satisfies the flat-off condition 

I {Mt-Zt)dL*t = a.s. 

Proof, (a) First, note that the increase property and the continuity 
of the mapping m i— > Zt{m) imply that Lt is the right-point of the closed 
interval {m, Zt{m) = Zt}. 

Then note that, for a < C? Tt{m) < a, if and only if, there exists s € [t,a] 
s.t. Zs{m) = Zg, or equivalently, Lg > m. This consequently leads to the 
following series of identities: 

{Tt{m) =t}= f] {Tt{m) <t + a} 

= Pi {3s G [t,t -\- a];Ls > m} = < limsupLs > m 

a>0 ^ «i* 
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However, since Tt{m) = t ii and only if Lt>m, it immediately follows that 
Lt = lim sup J, Ls and Lt is upper-right semi-continuous. We hence get 

Tt{m)<a <^=^ 3sG[t,a]; m<Ls <^=^ m<Ll^. 

This last equivalence in conjunction with the preceding lemma easily im- 
plies that Lj Q, = Kt{a) for any a € [t, C]- 

(b) (Lg f)t>o is obviously an increasing process. Let 5 be a stopping time 
corresponding to an increasing point of Lq .. 

If 5 < C, it necessarily satisfies supo<t<^I/( = sviY>s<t<c^ti whence Ms = 
Zs- 

If 5 = we have that L* g_ < Lg, otherwise the increasing process does 
not jump at Q. However, = and Mq = Lq^_ V L^. It immediately 
follows that = and the flat-off condition is well satisfied. Thus, by 
Theorem 2.8, this immediately yields the uniqueness of the martingale in 
the Max-Plus decomposition Ms = Zs ® Lq s-, where S satisfies Ls = Lq g. 
□ 



Proposition 4.6 together with Theorem 4.8 allows to study the regularity 
of the derivative of the value function Cs'^{Z, m) w.r.t. the strike m. We say 
that there is smooth pasting if the two derivatives coincide at the optimal 
stopping boundary determined by m = = sup{m; C^™(Z, m) = Zs — m}. 
The following corollary gives a full description of the right-hand derivative 
jumps at the boundary and establishes the conditions under which smooth 
pasting occurs. 

Corollary 4.9 (Smooth-fit principle). 1. The left-hand and right-hand 
derivatives of the American Call price Cg"^{Z,m) w.r.t. m can he expressed 
as 

^C^^{Z,m) = -P[Z<^ V > m\Ts], 



^C^^^{Z,m) = -P[Z^ V L^^ > m\Ts] a.s. 

2. The left-hand derivative is almost surely continuous at the boundary 
m = Ls: 



d- 



d- 



—CriZ,m)_^ =—{Zs-m) 



= -1. 

m=Ls 



'm=Ls dm 

3. The right-hand derivative is not continuous at the boundary if 

(4.5) P[Z^ V L*s,^ = Ls\Ts] = P[Lt<Ls,Z^< Ls Vt G [5, C] iJ's] > 0, 

and, hence, the smooth-fit principle does not occur if the conditional distri- 
bution function of Z(^ V L*g ^ jumps at the point Ls ■ 



30 



N. EL KAROUI AND A. MEZIOU 



The first item of Corollary 4.9 follows from the convexity property of the 
mapping m i— > Zs{m), which implies that ^^Zsim) = lim^jo §Wi^s(^ ~^ 

It is interesting to note that, when the underlying Z evolves according 
to a positive multiplicative Levy process, the smooth- fit principle we have 
defined here is equivalent to the "classic" one usually met in the context of 
American Put options (see [3], Theorem 6). In fact, in light of equation (3.5), 
the American Call prices are transformed into "classic" American Put prices 
with a discount factor, by simply exchanging the strike and the spot price 
of the underlying {CQ^{Z,m) = Put^™(m, Zq)), and so any point m of our 
boundary corresponds to a point x of the American Put boundary such that 
L{x) = bx = m. 

Remark 4.10. Recall that the stopping time Ts{m) A C is optimal, 
whereas Ts{m) is not. Moreover, the smallest optimal stopping time is 
Ts{m) = Ts{m) A 9s{m), where 9s{m) is defined as the first stopping time 
after S at which Z.{m) equals m. 

The mapping m ^ 9s{m) is nonincreasing, with effective domain Domg : = 
{m]9s{m) < C} = [-f^s.C; where Ks^( is the smallest value of m for 
which Zs{m) — m = 0, that is, 

Ks,(; := - ess sup ^5 ,. = essinf{ys|y5 G J^s, Is > ^s,f a.s.}. 

Observe the following: 

• If S and T are two stopping times such that S <T, then Ks,(; > ^T,c,- 
In fact, since any .7^5-measurable variable is .T-^-measurable, we have 

Ks,c = essinf{y ^Ts,Y> > Z^^^ a.s.} 
> essinf{y G J^t, > ^t,^ a.s.} = ETt.c- 

• For all stopping times U > S, Zs{Ks^() = Zi/{Ks^() = , a.s. 

4.4. Max-Plus decomposition and American options. We focused in Sec- 
tion 3 on the problem to find an optimal stopping time to an American Call 
option written on a supermartingale underlying of class {T>). 

In the present section we are concerned with more general American Call 
options without discount factor, written on a (D)-regular underlying Y not 
necessarily defining a supermartingale. We denote by Z^ the Snell envelope 
of Y, which also defines a (X')-regular process by [14, 31]. The filtration (Tt) 
is assumed to be quasi-left-continuous in the following theorem. 

Theorem 4.11. Let Y be a (D) -regular process, Z^ the Snell envelope 
of Y and C!^'^{Y,m) the price of an American Call option, given at any 
stopping time S <( by, 

C^""(y, m) = ess supE[(y, - m)+\Ts] ■ 

T>S 
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1. The American Calls written on Y and , respectively, have the same 
price: 

C^^(Y,m) = Ci'^{Z^,m). 

2. Let L5 be an index process in the Max-Plus decomposition of Z^ . The 
stopping time Tg (m) f\C,:= inf{f > S; Lf > m} AC, is an optimal stopping 
time. 

Intrinsic characterization in terms of Y. 

3. Define the stopping times Ds and Tg{m) by 

Ds:=mi{t>S;Z'f = Yt}, 
Tj(m) := inf{t > S; Cf'^iY, m)=Yt-m}. 

Then DrpZf^^-^^^- = TJ (m) A ( and m i— > Tg{m) A C is nondecreasing and 
left- continuous. 

4. Set := sup{m; Cg^{Y, m) =Ys — m} and LJ'* = supg<j<„ LJ . Then 

Lg'^ = for any stopping time S < C o,nd C_5™(y, m) has a closed 
formula given by 

C^^{Y,m) = E[(l|'* V - m)+\Ts] = E[(4;* yY^- m)^\Ts]. 

Proof. 1. First note that C(''^{Z^ ,m) = esssupt<5<^E[Z|' V m\Tt\ - 
m := Zj{m) — m. 

Let Z' be a super martingale dominating Y y m. Since Z' dominates 
it also dominates its Snell envelope Z^ . We immediately deduce that Z' 
dominates Z^ V m, and its Snell envelope ZY {m) as well. Hence, the Snell 
envelope of y V m dominates ZY (m), and as the reverse inequality trivially 
holds, the desired result follows at once. 

2. At the beginning of this section, this point has been already proven for 
any index process L satisfying the Max-Plus decomposition of Z. We here 
give another specific proof for the index process L constructed in Section 4. 

Thanks to Theorem 4.3, the stopping time Tg{m) A C, defined by 

r|(m) A C = inf > S- C^^{Y, m) = - m} A C 

is optimal. Let be the index process in the Max-Plus decomposition of 
Z^: 

Lf = sup{m; Z\{m) = Z^} = sup{m; C^"(Z^, m) = - m}. 

Tg (m) defines the left-hand inverse of a i— > Lg'^ and thus satisfies the above 
relation in Theorem 4.11. 

3. To simplify the notation in the proof, we will omit the parameter m 
from the expressions of both stopping times Tg[m) and Tj[m). 
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Set Ds{m) := Dj^z/,^ = mf{t > T| A C; = Yt}. Since Dsim) is the first 

stopping time after Tg A C, at whicli Y readies its Snell envelope , we 
immediately get by the optimal stopping theory 

(4.6) Z^z^^ = E[Yd<,(™) 

Thanks to the optimality of the stopping time Tg AC for ZY {m), Z^Z/^^{fn) = 
sup(ZJ^2 ,m) and, hence, 

ig AC, 

(4.7) < E[sup(yo^(„), m)|^y|^^^] 

< Z^z^^im). 

Thus, the chain of inequalities is indeed a series of equalities which proves 
that Ds{m) is an optimal stopping time starting from A C- 

Now note that Zj,z{m) = Zrpz > m on the set {T^ < C}. This observation 

together with (4.6) implies that ^^^(m) >'m on {Tg < ("}. This allows to 
reinterpret Ds{m) as TJ. In fact, on the set {Tg < (}, 

Ds{m) = mf{t > T|; (m) = = Yt} = inf{t > S; Zj {m) = Zj = Yt}, 

where the second equality follows from the fact that Tg is the first stopping 
time after S at which ZY {m) = Z^. 

We finally get Tg = Ds{m) on the set {Tg < (^}. Moreover, since Ds{m) < 
C, this imphes that TJ < C on {T| < C} and, hence, {T| < C} = {Tg < (}■ 
Then it is immediate to see that Ds{m) = -Dj^zj-^)^^ = TJ (m) A C- 

Now we would like to extend the properties of Tg{m) w.r.t. m (left- 
continuity and nondecreasing property) to the stopping time (m) , via the 
mapping Dt-ltis straightforward that m i— > Tg{m) A ^ is nondecreasing 
since Dt is nondecreasing. In the same way, we would immediately get 
the left-continuity \i Dt were left-continuous. The problem is that this 
last property is not true in general, but Dt will be left-continuous along 
the stopping times Tg (m) A C- 

Let us set Dg{m) : = lim | Dsim — e). Thanks to the quasi- left-continuity 
of Z^ and Y and the increasing property of m i— s- Dsim), the preliminary 
remarks in Section 4.1 imply that 

E[^^,(„_.)]-E[Z^„(^^)] and E[y,,, E[y^^^(^)] as 6 ^ 0. 

Since Z|^^^^_^^ = yDg(m-e) and Z^ > Y, it immediately comes that Z^_^^^ = 
^D~{m) hence, Dg{m) = Ds{m) since Ds{m) is the first stopping time 
U after T| A C satisfying Z^ = Yu. 
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4. The running supremum L^'^ can be expressed as L^'^ = sup{m; Tg{rn) < 
u}. Then m ^ [m) and m ^ {m) define two different nondecreas- 
ing left-continuous mappings. Their right-continuous inverses u ^ L^'* and 

u ^ I-^'u therefore different but with same value at C,, thanks to the 
following equivalences: 

T^{m)<C i'^<lZ]( and rj(?n) < C T§{m)<C. 

Then applying Theorem 4.8, it comes that 

C^^'iY, m) = E[Lf ■* V m\J^s] - m 

= E[(l|'* - m^lTs] = E[(Lg - my\Ts]. □ 

Remark 4.12. It should be noted that the increasing processes [Lq \ ) 
and {Lq'*) are in general different. This can be easily checked in the deter- 
ministic setting where Zj = supj<„<2-l^. The price of the American Call 
option can be then expressed as 

C^'^{Z^,m)= sup {Zl-m)+= sup ( sup {Y^ - m)+] 

t<u<T t<u<T\u<v<T / 

= sup (y„ - m)+ = m) = {ZY - m) + . 

t<v<T 

As for the index processes and , they are different. In fact, 

Lf = sup{m; Zf (m) =Zf} = sup{m; V m = ZY} = Zf , 

lJ = sup{m; V m = Ij} = sup{m; Z^ V m = Z^ = 

So if Z^ = Yt, then = LJ = Zj , otherwise LJ = — oo. 

Let a define a real such that supj<„<2- Yu = Yo, = Zl = Z^. If Q < t, then 

W,t =Zo = Lq'i , otherwise L^'^ =-oo^ Lq ^ . 

4.5. Markovian case. In a Markovian framework, we can reduce the 
study of all processes to that of functions. 

Let X be a strong Markov process ("a right process"), quasi-left- continu- 
ous, with lifetime C and topological state space E whose Borel cj-field B{E) 
is separable. 

The aim of the section is to reconsider the different steps of the Max-Plus 
decomposition in the Markovian case, in order to highlight the Markovian 
aspect of the different involved processes. For this, we are particularly in- 
terested in excessive functions / such that f{Xt)l{t<(} define cadlag super- 
martingales. The problem is to show that the Max-Plus decomposition of 
f{Xt)l^t^Q can be expressed through an index process Lf = L{Xt). Then 
the problem is simply formulated as following: 
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Given an excessive function f on E, does there exist any function L such 
that 



(4.8) 



sup L{Xt) 
o<t<C 



In the one-dimensional case and if L is nondecreasing, equation (4.8) is equiv- 
alent to f{x) = Ea;[L(supo<t<^-'^^t)]. This kind of representation is somewhat 
unusual, since the classic potential theory involves a classic integral instead 
of a Max-Plus one. It appears, for instance, in the paper of El Karoui and 
Follmer [15] who have particularly shown that any function u satisfying some 
very mild regularity conditions admits a nonlinear Riesz decomposition in 
terms of a nonlinear potential subadditive operator G and a corresponding 
superadditive operator I?) which is a derivator in the sense of the nonlinear 
potential theory developed by Dellacherie [12]: 



u{x) = Ea, 



sup Du{Xs) dt 



Q<s<t 



GDu{x) 



Let Ptf be the semigroup of the Markov process X (with Pjl < 1), defined 
by Ptf{x) = ^^[f {Xt)l{t<c}\- A function / is said to be excessive if 

f(^B{E), Ptf{x)<f{x) and Ptf{x)^f{x) as t ^ 0. 

Let B^{E) be the a-field generated by the excessive functions. 

With such a semigroup, the process X is only sub-Markov. In order to 
make it a Markov process, we need to add a "cemetery" point d to the state 
space E. We also extend all the functions defined on E to null functions at 
the cemetery point d. 

Then we introduce a realization of this Markov process on a space (0, {J-f), 
9t, Xt, C, Px)) with a translation operator 9t (on {t < (}, XfoOg = Xt+s), and 
a lifetime C {C ° = C - t on {t < C}, and Xt G {d} on {t > (})■ T"" denotes 
the natural filtration generated by B^{E) and X. It is the completion of 
a{f{Xs);s <t,fG B'^{E)) with respect to the family {P^^; n a finite measure 
on V{E)}. 

Then for any excessive function /, f{Xt)l^t«:;} is a cadlag supermartin- 
gale for all probability measures (P/^;^ € V{E)). This allows us to avoid 
any continuity assumption upon /. Moreover, for any g G B^{E), the pro- 
cess g{Xt)l^t^^j is optional. 

Let Yt = g{Xt)l^t^(^j be a (X')-regular process for any probability measure 
(P^), where g is assumed to be nonnegative. This assumption is not really 
required, but from the point of view of the Snell envelope and since = 0, 
it is equivalent to consider Sn(y) or Sn(y VO). 

Then let us focus on the Snell envelope of Y. According to [14] and [18], 
it is associated with the function Rg, defined as the smallest fixed point of 
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the operator Kg:B^{E) -^B^{E), such that Kg{x) = sup^gQ P^^l^;). Note 
that g>0^ Rg>0. We hence get 

(4.9) Rg{x) = snj>B,[g{Xr)l{r«;}]. 

Rg can be in fact identified to the smallest excessive function that dominates 
g. If we are at time t, equation (4.9) becomes 

^5(-'^t)l{t<C} =esssupE^[5f(X^)l|^<^||J^4], P;,-a.s., 

and then the addressed problem (4.8) comes down to find an optimal stop- 
ping time to the American Call option C^™(y, m) written on Y and with 
maturity C- 

Note here that any constant m cannot be taken as a function on E. In 
particular, to avoid any ambiguity, the corresponding constant function will 
be denoted by mlE- 

Theorem 4.13. Let X be a strong Markov process quasi-left- continuous 
and v{x,m) = R{g — m)'^{x) + mlE{x), for m>0. Then: 

(i) The Max-Plus decomposition of Rg{Xt)l{t<(} time is given by 



(4.10) Rg{x) = E 



sup L{Xu) 
.0<«<c 



where L is the function defined on E by 

L{x) := sup{m; R{g — m)'^ (x) = g{x) — mlE{x)} (and elsewhere). 

(ii) More generally, the price at time of the American Call C^"'{Y,m) 
is given by 

R{g - m)+{x) = sup (L - m)+(X„) 

.0<M<C 

and an optimal stopping time is characterized by 

rj"(m) AC = inf{t >0;L(Xt) >m} AC- 

The proof of Theorem 4.13 is simply based on the observation that the 
Snell envelope of g{Xt)l{t^Q V m is given by 

v{Xt,m)l^t^^} + ml{t>Q. 

Moreover, equation (4.10) shows that the initial problem (4.8) admits a 
solution, which was not clear a priori. However this solution is not necessarily 
unique, since there is no uniqueness for the nondecreasing processes involved 
in the Max-Plus decomposition of Rg{Xt)l^t<(}- 

A direct discussion of the Markovian case and further results concerning 
the uniqueness of L can be found in Follmer and Knispel [26]. 
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Remark 4.14. At time t, the Max-Plus decomposition of Rg{Xt)l^i^Q 
becomes 



{t«} 



sup L{Xu)\Tt 

t<u<C 



where x denotes the initial value of the underlying process (Xt), and the 
American Call price at time t is given by 



Rig-m)+iXt 



sup {L-m)+{Xu)\Tt 

t<u<( 



Example. Let us come back to the example of Section 3 and reinter- 
pret it in terms of a Markov process. The supermartingale Z defines a one- 
dimensional Markov process evolving according to a geometric Brownian 
motion 

—L = _rdt + adWt, Zo = l. 
Zt 

Let us introduce a lifetime ^ assumed to be an independent exponential 
variable with parameter /? > and a cemetery point d (we set Zt = d, if 
t > C)- Z is hence extended to a Markov process with values in the enlarged 
space MU {5}. 

Then we formally define the identity function by Id{x) = x on M and 
Id{d) = 0. Note that, with this convention, the supermartingale Zt = Zt'S.s^t^Q 
introduced in Section 3 can be written as Zt = Id{Zt). 

Thanks to Theorem 4.13, the Snell envelope Z.{m) of ZV m is a function 
of {Z,m) and can be decomposed as following in the Max-Plus algebra: 



Zt{m) = E 



sup L{Zu)l{u<(;}\/ m\J^t 

i<M<C 



for t < (, and m for t>(^, 



where L{x) — 
pie 3.6). We finally obtain 



^ ^x, as we have seen in Section 3 (cf. Lemma 3.5 and Exam- 



Z, = E 



sup —^Zul{u<n\yt 

t<u<C 



5. Optimality of Max-Plus decomposition w.r.t. convex order. For the 

sake of completeness, we first give some useful definitions and properties of 
stochastic order, which expresses the notion of one entire probability distri- 
bution being less than or equal to another. This order which was introduced 
in Economics by Rothschild and Stiglitz [43] as a measure of risk gives a 
systematic framework for analyzing economic behavior under uncertainty. 

More generally, stochastic order relations provide a valuable insight into 
the behavior of complex stochastic systems. Application areas include queu- 
ing systems, actuarial and financial risk, decision making and stochastic 
simulation. 
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5.1. Basic properties of convex order. 

Definition 5.1. Let Xi and X2 be two real- valued random variables. 
We say that Xi is less variable than X2 in the convex stochastic order, and 
we write Xi <cx X2 if for any convex real- valued function g for which the 
following expectations are well defined: 

(5.1) B[g{X,)]<B[giX2)]. 

When E[Xi] = E[X2], the test functions can be reduced to ^mix) = xV m 
for all reals m. 

Let us point out some basic facts concerning stochastic order: 

• The convex order compares the "dispersion" of random variables with 
equal mean. In particular, by considering specific convex functions, it can 
be easily seen that 

-'^i <cxX2^ Var(Xi) < Var(X2) whenever Var(X2) < 00. 

However, the converse implication does not hold. So, indeed, the convex 
ordering is stronger than ordering of the variances since it takes into account 
irregular or asymmetric risky prospects. 

• Recall that a real-valued function g is convex if 5((E[X]) < E[(/(X)] for 
all r.v. X. We particularly get that E[X] <cx X for all r.v. X. More generally, 
note that if (7 is a convex function, then, by Jensen's inequality, 

E{5(E[X2|Xi])} < E{E[5(X2)|Xi]} = Eb(X2)]. 

This means that E[X2|Xi] <cx X2. This property is in fact characteristic in 
the sense of the next beautiful Strassen^s theorem, which characterizes the 
convex order by construction on the same probability space: 
^If Xi and X2 are two r.v. such that Xi <cx X2, then there exist two r.v. 
Xi and X2 defined on a common probability space such that 

Xi = Xi for i = l,2 and Xi = E[X2 \Xi] a.s. 

This theorem on stochastic dominance is a crucial tool in the theory of in- 
teracting particle systems, and has also found many interesting applications 
in other areas. See [27] (Corollary 2.100) or [40] for a proof of the theorem. 

• Note that Xi <cx X2 is equivalent to —Xi <cx —X2. This means that, 
contrary to the monotone convex orders, the convex order is independent of 
the interpretation of the random variables as loss or gain variables. 

• It is said that Xi is smaller than X2 in the decreasing convex order, writ- 
ten Xi <dcx ^2, if inequality (5.1) holds for all decreasing convex functions 
g, for which the expectations exist. 

This particularly implies that E[Xi] > E[X2] and if the two means are 
equal, then the decreasing convex order reduce to the convex order. 
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• Note that the decreasing convex order is strictly equivalent to the classic 
second order stochastic dominance relation in finance, which is the increas- 
ing concave order. It is a fundamental model of risk-averse preferences and 
has an equivalent characterization by utility functions. The term "decreas- 
ing convex" is natural when we are dealing with minimization rather than 
maximization problems. In fact, von Neumann and Morgenstern have devel- 
oped the expected utility theory [39]: for every rational decision maker, there 
exists a utility function u{-) such that the decision maker prefers outcome 
X over outcome Y if and only if E[ti(X)] > E[ti(y)]. In practice, however, 
it is almost impossible to explicitly elicit the utility function of a decision 
maker. Additional difficulties arise when there is a group of decision makers 
with different utility functions who have to come to a consensus. 

In terms of utility theory, X <dcx Y means that E[it(X)] > E[ii(y)] for 
every nondecreasing and concave utility function ti(-), that is, the gain X is 
preferred to the gain Y by all risk averse decision makers. 

We refer the reader to the book by Shaked and Shanthikumar [44] for an 
overview of the convex order and other stochastic orders. 

5.2. Martingale optimization problems. It is natural to address the prob- 
lem to "find the smallest martingale" dominating a floor process in finance, 
where martingales may be seen as self-financing portfolio strategies, and also 
in fair games language, where martingales may be thought of as the fortune 
earned by a betting strategy. 

However, the set of martingales is not stable with respect to the infimum 
operation, since the inf of two martingales defines a supermartingale and not 
a martingale. Hence, the problem has no solution in general and we have to 
weaken the assumption of the "strong order" to a convex stochastic order. 
While this kind of problem, set in terms of convex order, is somewhat unusual 
in finance since we consider in general only one convex function, it seems to 
be more classic in other areas of probability theory. For instance, Kertz and 
Rosier have addressed in [33] a martingale problem similar to ours, in which 
the optimization is also related to the convex stochastic order on terminal 
values. However, our domination path constraint is replaced by a constraint 
imposing that the distribution of the maximum of the martingale is a given 
probability measure v. The solution is thoroughly characterized, using the 
notions of Hardy-Littlewood maximal functions and convex envelopes. 

Let us formulate our "new" constrained optimization problem in terms of 
convex order. We use the same notation as in Section 4.4: is the Snell 
envelope of a real- valued optional process Y of class {T>). 

Introduce the following set of admissible martingales: 

= {{Mt)t>o u.i. martingale \Mq = Zq and Mt >Ytyt£ [0, (]}• 
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Note that any martingale dominating a floor process Y necessarily dominates 
its Snell envelope and, thus, in order to satisfy the floor constraint 
Mt > Yf for all t <C, the initial value of any admissible martingale M must 
be at least equal to the initial value of the Snell envelope of Y, that is, 
Mo>Zo^ = sup,gro.cE[n]. 

Our aim is to find the smallest martingale M* in A4^ with respect to the 
convex stochastic order on the terminal value, that is, <cx for all 

martingales {Mt)o<t<(; in . 

First, it is easy to check that the set of admissible martingales is not 
empty since it already contains the martingale M^{Y) of the Doob-Meyer 
decomposition of . 

Moreover, it is shown in [42] that this martingale M^{Y) achieves the 
minimum over all martingales M with initial value Zq, in the following 
representation: 



(5.2) 



infE 

M 



sup [Yt - Mt) 

■te[o,C] 



+ M( 



0- 



However, it is also trivially the case for all admissible martingales in M. 
since 



E 



sup {Yt - Mt] 

■t6[0,C] 



+ Mo < E 



sup {Zi - Mt] 



+ Mn < Mn = Z 



Y 
'0 



yM£M^. 



The addressed problem is in general difficult to solve and usually we just 
consider the Doob-Meyer martingale M'^(y). 

The following theorem states that the martingale M^'®, introduced in 
Section 4.4, solves our constrained optimization problem, and then, in par- 
ticular, M^'® is less variable than M^{Y). We still assume in the theorem 
that the filtration (J^t) is quasi-left- continuous. 

Theorem 5.2. The martingale M^'® of the Max-Plus decomposition of 
Z^ is the smallest martingale in , with respect to the convex stochastic 
order on the terminal value. 



Proof. Let {Mt)o<t<( be an arbitrary element of and (LQ t) the 
nondecreasing process in the Max-Plus decomposition of Z^ . We shall prove 
that M^^'® <ca; M^. 

Since M dominates Z^ , the Snell envelope Z^(m) of [MM m) also dom- 
inates (Z.(m)). 

However, since we have previously observed that Zg^m) = E[iVf(^ \J m\!Fs\ 
for all S in T, it immediately follows that 

E[M^ V m\rs] > E[L^^^ V V m|J^5] V5 G T. 
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More generally, this inequality holds true for any convex function g that is 
(5.3) ng{M(;)\Ts] > E[5(L^,c V Zl)\Ts] VS G T. 

The terminal condition is M® = Lq ^ V , and so equation (5.3) implies 

E[g(M^)] > E[g{L* ,^ V Zf)] > E[g{M^'®)] and the martingale {M^'%<t<( 
is optimal indeed. 

It should be noted that the same argument can only be used for stopping 
times S such that Lq ^ = L5, that is at the increasing points of Lq .. □ 

Observe that: 

• If we impose an other initial value m for all admissible martingales in 
Ai"^ , m must be necessarily greater than Zq, otherwise the problem has 
no solution. Then the same results hold if we replace the increasing process 
(^^t')t>o by {lIi* V m)t>o. 

• Since the initial value of any martingale is equal to its mean, the formula- 
tion of the initial condition strongly depends on the selected stochastic or- 
der. If we consider the convex order, all admissible martingales must have 
the same initial value m, whereas if we consider the decreasing convex or- 
der, the initial value of any admissible martingale M must not exceed the 
initial value of any optimal solution to the problem. It must also be equal 
or greater than Zq. Note that while the original optimization problem 
was difficult to solve, the dual one (passing through the Snell envelope 
of a convex family of processes and its decomposition in the Max-Plus 
algebra) is much simpler than the first one and requires only tools from 
convex analysis. 

Remark 5.3. If we consider a new financial environment in which port- 
folio strategies are martingales, the problem treated here can be applied to 
portfolio insurance. In fact, it can be seen as a particular portfolio selection 
problem where an American constraint is imposed on the liquidative value of 
the open fund. Traditionally, investors are assumed to possess an increasing 
concave utility function u and the portfolio choice consists in maximizing 
the expected utility of final wealth, over the set of admissible portfolios. 
In practice, however, it is almost impossible to explicitly elicit the utility 
function of a decision maker. 

In our approach, the optimization is performed with respect to the convex 
ordering on the terminal value and the optimal strategy is thus robust to 
different preferences. This model is hence very useful, especially when there 
is a group of decision makers with different utility functions who have to 
come to a consensus. The interested reader is referred to [20] for more details 
on the application of the martingale problem to portfolio insurance. 
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5.3. Max-Plus martingales and Levy processes. As we have seen in Sec- 
tion 3, processes with independent stationary increments give us nice ex- 
amples where the Max-Plus decomposition can be described in quasi-closed 
form. While the focus of Section 3 was the link to American options and 
characterization of optimal stopping times, we rather emphasize here the 
different martingales involved in the Max-Plus decomposition of Levy pro- 
cesses. The interesting distinction to make here is between infinite horizon 
time and an independent exponential random variable one. We consider both 
cases and determine in each one the closed form and the dynamics of the 
Max-Plus martingale M®. 

5.3.1. Analytical result. Let Z he a geometric Brownian motion with 
parameters (— r, a) and initial value Zq = x. We just recall some classic 
results on the probability distribution of the running supremum of Z, that 
is, Zf := Zq^^ = supo<u<t Zu- 

Lemma 5.4. Set 7 = 1-1-^ and 6 the root greater than 7 of y'^ — — 
^ = 0. Let C be an independent exponential variable with parameter /? > 0. 
The case where C is infinite a.s. corresponds to (3 = and will be considered 
together. 

s 



1. P[Z;>ml= — Al and F,[Z;] = x. 



m X 



if m> X 



2. E[{Z^-m)+] = l S-l\m/ " ^Q{x,m). 

—X — m, if m <x 

Proof. 1. The proof is based on the equivalence {Z^ >m^ Tm < t}, 
where Tm := inf{t; Z^ > m}. So, P[Z^ >m] = E[exp -/JT^] and even if /? = 
0, P[Zo% > m] = P[T„, < +00] = lim^^o E(exp -/JT^). 

To calculate these quantities, we apply Doob's theorem to the well-selected 
martingale, e~^^Zf, where 6 is the positive root of the equation 6"^ — 'yS — 
^ = 0, (5 = 7 if /? = 0). So, E[e-^(^'"^*)Z|,^^J = x^. Since e-^(^-^*)Z|,^^^/^t 
is nonnegative and bounded by m V x for all t, when t — > -|-oo, the left-hand 
side goes to (mVx)^ x E[e~^'^'"] = {mV x)^ x P[Z^ > m]. This proves item 1. 

2. More generally, for m>x, the price of a Call option on the supremum 
is given by 

+00 r+00 / X \^ , m f X 



But iim<x, Z^> m and E[(Z^ - m)+] = B[Z^ - m] = ^x - m. □ 



a + m J 5 — l\m 

5 



42 



N. EL KAROUI AND A. MEZIOU 



This lemma proves Proposition 3.4. We first assume the maturity ^ to be 
infinite. 



5.3.2. Infinite horizon. Multiplicative Levy processes. Let Z he a multi- 
plicative Levy process such that E[Zq^] < +00. The Max-Plus decompo- 
sition of Z has a closed form thanks to the independence property of its 
relative increments. 

Geometric Brownian motion. 



Proposition 5.5. Let Z be a geometric Brownian motion with param- 
eters (— r, a), and set 7 = 1 -|- The martingale of the Max-Plus decompo- 
sition of Z can be explicitly characterized as a function (f)^ of {Zt, Z^) : 



7-1 

7 



z; 



1 



-tJz) +1 



f{Zt, zi). 



-i-i\zt 

In particular, M® = Zt® Lq^ if and only if Zt = Zl . 

Moreover, as a martingale, Mf can he represented as a stochastic integral 



dM? = — 
Zt 



ZtX'-'^ 



aZ.dWt. 



Proof. By the uniqueness Theorem 2.8, Mj® = h^'E[ZQ^^\Tt] is the mar- 
tingale of the Max-Plus decomposition of Z. Since the distribution of Zq ^ 
is well known, there exists a closed formula for M® as a function of {Zt, Z^): 



(5.4) 



M9 



b^B[{Zl^-Z;)+\J^t]+b^Zl 

■zi 



b^ZtE 



,^ t 



-h b^Zt . 



Zt Zt 

Since Z^^/Zt is independent from Z^ /Zt and has the same distribution as 
Zq 00/^1 equation (5.4) can be rewritten as follows: 



(5.5) 



Mf 



: b^ZtC*{l,mt) -\- b^Zt, 



Z* 

with rrit := — > 1. 
Zt 



Then substituting mt in the last expression of Lemma 5.4, we explicitly 
determine M®: 



7-1 

7 



Z* 



1 



ZtV 

T^] +1 



({Zt, Zt). 



^-1\Z* 

Since the associated nondecreasing process is in the form of Lq j = b^Zt = 
-Zt , it can be immediately seen that the martingale M® is different from 



7 

Z\/L, 
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The function x ^ 7^^;'^ — — 1)+ is nonnegative on [0, 1], null at and 

1 and reaches its maximum at the point = 

Then M® = V Lq ^ if and only if Zt = Z^, that is, if and only if t is a 
point of increase of the process Lq .. 

In addition, since M® = (j)y(Z,Z*) is a martingale, by Ito's formula, its 
decomposition as a stochastic integral needs only to know the derivative of 
(p-y w.r.t. Z:dM® = ^{Zt, Z^)Zta dWt. We hence obtain 

(5.6) dM®=(^^y~\zM=(^^y~\M,^ 

where denotes the martingale of the Doob-Meyer decomposition of Z. 
From (5.6), we can particularly observe that M® is less variable than M"^. 
□ 

Geometric Levy process. Let C^^{Z^m) be a perpetual American Call 
written on a geometric Levy process Z defining a supermartingale, and with 
strike m. The main difficulty to compute its price comes from the complex- 
ity of Lookback options closed formulae. Based on the paper [38], we have 
explicitly determined in Section 3.2 the price of such a Call, in the partic- 
ular case where Zt = xe-^^ , with X defining an upper semi-continuous Levy 
process (i.e., a process with no positive jumps). Then using the relation 
M® = C^'^{Z,bZ;) + bZ* which follows from equation (5.4) and Proposi- 
tion 3.2, we easily deduce a closed formula for the Max-Plus martingale M® 
as a function (p^y^^^^y of {Zt, Zt). (p^hsvy same form as in Proposition 5.5 

and 7Levy > 1 is such that K(7Levy) = 0. 

Brownian motion with negative drift. Let Z define a drifted Brownian 

2 

motion with parameters {—fx, a), where ^ = r -|- ^ and initial value 0, and 
assume the maturity ^ to be infinite. The martingale of the Max-Plus de- 
composition of Z has a closed formula based on the independence property 
of the increments of Z. We have seen in Section 3.3 that Zt takes the simple 
following form: Zt = E[Zf — b\Tt], where b is set to be equal to E[Zqqq]. 
Then by the uniqueness theorem 2.8, M® = E[Zq ^ — b\!Ft] is the martingale 
of the Max-Plus decomposition associated with the running supremum of 
the process Zt — b. The law of Zq^^ can be deduced from Lemma 5.4, and 
so we obtain a closed formula for M® as a function of {Zt,Z'^^). 

The following proposition provides an explicit characterization of M®. 
The proof is omitted here since it is strictly analogous to that of Proposi- 
tion 5.5. 

Proposition 5.6. The martingale M® associated with the Max-Plus 
decomposition of Z is of the form 

(5.7) M® = i[exp(-7(Z; - Zt)) - 1] + := (/.(Z^, Z^). 
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In particular, M® = Zt (B Lq ^ if and only if Zi = Z^ . 

Moreover, as a martingale, M® can be represented as a stochastic integral 



dM^ 



■ exp(-7(Z;^ - Zt))adWt = exp(-7(Z; - Zt)) dM( 



5.3.3. Independent exponential r.v. horizon. Now, we assume that the 
maturity C defines an independent exponential r.v. with parameter /? > 0, 
and Z a geometric Brownian motion with parameters (— r, cr). We use the 
same notation as infection 3.2.2. 

The martingale M® associated with the Max-Plus decomposition of Z is 
of the form 



sup Zu\Gt 

0<u<C 



bpE[zi^\gt] = bpE[zi^\gt]. 



Since the distribution of Zq ^ is also explicit in this case, we can again deduce 

a closed formula of M® as a function of {Zt, Zq J, for t < 

Note that the law of Zq^ has the same form as within the infinite time 
horizon, but 7 is replaced by 6. Then, the calculations_^are strictly identical 
and lead to the same closed form for the martingale Af®. 



Proposition 5.7. 1. The Max-Plus martingale associated with Zt 
Zfl^tKt;} of the form 



1 



d-i\z* 



Zt^' 



^ +1 



4>5{Zt,z^ 



for allte[0,C]- 



In particular, M® = Zt (B Lq t if md only if Zt = Zl . 

2. As a martingale, M® can be represented as the sum of a stochastic 
integral and a purely discontinuous martingale, for all t <(^, 



dM^ = ( ^ 



Zt 



V{t<QdM^ + l^Mf_dNt, 



wh 



ere Nf := l|^<t} - A C) and AM®_ = M® - 



' 5 \z*l ■ 



Proof. 1. For any t < (, Mj^ = ^ZtE[mt V -^{Gt], where mt = ^. 

Z* Z'^ 

Since is conditionally independent given Qt and distributed like -2^, 



then, applying Lemma 5.4, we obtain M 



5-1 



1 



-ZtE 



mt V 



z 



c 

IZt 



Z^, and for t < (, 



'B[{Z*^-mtx)+]+mtx) 
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2. At time C, the process Z jumps from Z^- = to 0. So, the martingale 
M® has also a jump of size 



am: 



f = Mf - M® = MZc,z*^) - MZc,z*^) 



5 \Z*J 5\Z* 



Since the process Nf := l{f<t} — J^^^ Pdu defines a martingale and AM® 
is the value at C of a (^j)-predictable process, then 

M^ := AM® (I) 'd. 

is the purely discontinuous part of the ^-martingale M®. 

Observe that if Nf'"^ := — Z(^l|^<^}. + Jq^^ (3Zudu is the martingale corre- 
sponding to the jump of Z, then 

dM®.'^=i('^y"'divf''^. 

The continuous part of the martingale M® is given by M®'"^ = <ps{Zt;^(^, Z^^^) - 
Sq^'^ du with infinitesimal decomposition 

dMr=^(z,,c,^rAc)rf<c> 

where denotes the martingale of the Doob-Meyer decomposition of Z. 
□ 

Note that in the infinite time horizon case, M® was continuous even in 
C = cxD, since Zt vanishes as t — > oo. But here Z^ does not a priori equal 
Zq = 0, and thus, the martingale M® jumps at time C,. 

5.4. Azema-Yor martingale and Max-Plus decomposition. We leave in 
this section the framework of Levy processes and focus on a new example 
of Max-Plus decomposition where we can make explicit calculations with no 
assumption of stationary independent increments. 

So let Z be an increasing concave function n of a continuous local mar- 
tingale that goes to as t — >■ +00. Let us also assume the time horizon 
C to be infinite. Thanks to the concavity property of u, Zt = u{Nt) defines 
a local supermartingale. We further assume that E[|n(supj>Q A'"t)|] < +00 so 
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that Z is of class (P). Then setting = supo<s<j-/Vs and applying Ito's 
formula in the case where u is in the class C^, we observe that the process 

(5.8) Mt := u(iV;) + {Nt - iV;)7x'(iV;) = u{No) + f u'{N:) dN, 

Jo 

defines a local martingale. This key property has been greatly used by 
Azema-Yor without any concavity assumption, and particularly served to 
solve the Skorohod problem in [5]. More generally, the same property still 
holds if Nt jumps but not , which is the case, for example, for any positive 
martingale with only negative jumps. 

5.4.1. Max-Plus martingale and Azema-Yor martingale. Since u is con- 
cave, it comes that u{y) — u{x) < u'[x){y — x) for all reals {x,y), and so the 
martingale Mj dominates Zf = u{Nt). 

We aim to apply the uniqueness Theorem 2.8 in order to prove that M is 
the martingale associated with the Max-Plus decomposition of Z. For this, 
Moo must equal the terminal value of a nondecreasing process Lq . which 
only increases at points in time t such that L^t = Lt- 

As we have assumed that A^oo = 0, it immediately follows that > 
and 

Moo= lim Mt = uiN*^)-u'iN*^)N*^:=viN*^). 

Since v'{x) = —xu"{x) if u is regular and thanks to the concavity of n, v'[x) > 
if X > and the function v is nondecreasing on [0, +oo). Moreover, = 
(^^)oo since A^^ > 0, but we have not necessarily A"* = (A^''")^ for any time 
t. Hence, Mqo is the terminal value of a nondecreasing process v{{N'^)*) = 
supo<s<t -^^s, where Lg := u{N^) — u'{N^)N^ . In addition, while Nt < 0, 
{N^)t remains sticked to and does not increase. So the nondecreasing 
process v{{N~^)t) only increases when (A^"*")^ = A^^^ = Nt = N^ , that is, Mt = 
Zt [in light of equation (5.8)]. 

Consequently, M satisfies all the conditions of Theorem 2.8, which ensures 
the uniqueness of the martingale M = M® associated with the Max-Plus 
decomposition of Z. 

Moreover, thanks to the domination constraint M® > Zt and identity (5.8), 
it comes that 

u{Nt) < M® <u{N*), 

and thus, the running supremum processes of M® and Z are here indistin- 
guishable: Mf '* = Zt = u{Nt*), for all t > 0. 

These results can be summarized in the following proposition, where the 
filtration {J^t) is assumed to be quasi- left-continuous. 
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Proposition 5.8. Let Z he a local supermartingale of the form Zt = 
u{Nt), where u is an increasing concave function and N a continuous local 
martingale such that N^o = 0. The Max-Plus decomposition of Z is driven 
by the following processes: 

1. Zt = 'Ej[Ll^\!Ft] cLiT-d Lqj. = v{N*), where v is an increasing function of 
the form v{x) = u[x) — u'{x)x and Lg = v{N^) . 

2. Mf = u{N^) + {Nt - N^)u' (N^) . In particular, M® and Z have the same 
running supremum process: M®'* = Z^ = u{N*). 

3. The optimal martingale M® dominating the floor process Z, also satisfies 
the stronger drawdown''^ constraint: M® > u o n~^(M®'*). 

Previous revisited examples. 

• Note that the first case where Z is a geometric Brownian motion with 
parameters (— r, o") can be included in the scope of the following example. 
In fact, Z"' (with 7 = 1 + defines a martingale and so Zt = u{Nt), where 
u{x) = x"^!^ is an increasing concave function and Nt = Z^ ■ In particular, we 
can easily prove the result of Proposition 5.5 by simply using equation (5.8). 

Moreover, we do not need Lemma 5.4 to prove that the exercise boundary 
E''{m) = mE[Z(^^] of the perpetual American Cah C^"^(Z, m) is nothing 

else m^^^. In fact, using the Azema-Yor martingale (5.8), we get, for any 



7 

time i, 



E[M®] = E 



7 



Mq® = X. 



Then taking the limit of the preceding expression as t — +oo and since 
^oo = 0, we finally obtain the desired result. 

More generally, let Nt be a continuous exponential martingale of a stochas- 
tic integral such that a'^{Nt)dt = oo. Then the martingale associated 

with the Max-Plus decomposition of Zt = N^^"' has the same form as the 
one in the geometric Brownian case. 

• In the case of the considered Levy processes, Zt = xe^^ , where X has no 
positive jumps. So Z* is continuous and Nt = z]^"''^ defines a martingale. 
Then the rest follows exactly as before. 

• Let us now reconsider the case where Z is a drifted Brownian mo- 

2 

tion with parameters {—iJ,,a), where fi = r + It can be easily seen that 
exp(7Z() = Nt defines a martingale and so Zt = u{Nt), where u{x) = - log(2;) 
defines an increasing concave function. Then in light of equation (5.8), the 
martingale M® associated with the Max-Plus decomposition of Z is of the 
form 

M® = -log{Nn + (Nt - N,*)^ = Zl + -(exp7(Zi - Z;) - 1), 
7 l^t 7 
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and we hence find the same formula as in Proposition 5.6. This property 
is not typical for the Brownian motion and remains valid for more general 
stochastic integrals. 

Remark 5.9. These results do not only hold under the assumptions 
C = oo and A'^^o = 0. M is still the martingale of the Max-Plus decomposition 
of Z, for any time horizon ^ such that = v{N^), with v a nondecreasing 
function. 

5.4.2. Max-Plus decomposition and American options. Let us focus on 
the Snell envelope Zt{m) of Zt V m, where Z is of the form Zt = u{Nt). For 
this, we come back to the Azema-Yor martingale and make it start from 
time t instead of 0. Then, equation (5.8) becomes 



Since M* = E[M^|^f] and A'^^ = 0, we immediately obtain the Max-Plus 
decomposition of Z: 



Now let us consider the Snell envelope Zt{m) of Zt\Jm. In light of Section 4.3, 
Zt{m) is of the form 



Since 4>{^t) = ^[4>{Nt,oo) - ^t,oo4>' {Nt,oo)\^t] for any increasing concave func- 
tion (j), if we find such a function (p satisfying sup(t;, m) = (p — x(f>' , we imme- 
diately deduce that Zt{m) = (j){Nt). 

It can be easily seen that the function <j) exists indeed and it is of the form 
(j){x) = m if v{x) < m for any real x. In the contrary case, there exists some 
real x'^ satisfying v{x'^) = m [by continuity of sup(f ,m)] and 



Note that is well defined thanks to the nondecreasing property of v, and 
the function (j) is nothing else but the concave envelope of uV m. 

The following proposition precises the equivalence relation between the 
two functions u and v. 

Proposition 5.10. Let Z be a local supermartingale of the form Zt = 
u{N-t), where u and N satisfy the same properties as in Proposition 5.8. 
Then Z can be decomposed as follows: 



Ml = u{N:J + (iV* - N:Ju'{NI,) Vs > t. 



uiNt)=E[uiNl^)-Nl^u'iNl^)\Tt] = E[v{Nl^)\Tt]. 



Zt{m)=B[snp{v,m){Nl^)\J^t]. 




(5.9) 



Zt = E[viNl^)\Tt] 
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where v is a nondecreasing function defined by v{x) = u[x) — xu'{x). 

Conversely, if we know that the supermartingale Z admits the represen- 
tation (5.9), we can deduce that Zt is of the form Zt = u{Nt), where the 
function u solves the equation 

u{x) — xu'{x) = v{x). 

6. Conclusion. The paper suggests a new approach m martingale theory, 
which consists in looking for martingales under the form of a conditional ex- 
pectation of some running supremum process. Such martingales are nothing 
else but an extension of the Doob-Meyer martingales in the Max-Plus alge- 
bra. The analysis of these martingales and their optimality property suggests 
a lot of potential applications to the theory of martingales and their maxi- 
mum processes, via the Azema-Yor martingale, in particular. 

Moreover, our different point of view provides a unified framework for the 
solutions of many optimization problems related to the optimal stopping 
theory or the Bandit problem, and connects the notions of boundary and 
index process by means of the Max-Plus decomposition. 

Hence, the Max-Plus decomposition of supermartingales and the unique- 
ness of the associated martingale turn out to be very useful in many opti- 
mization problems and have a lot of application fields, like American options 
and portfolio insurance in finance. We also think that our approach could be 
related to other works around the Max-Plus algebra (large deviations, . . . ). 

APPENDIX: PROOF OF PROPOSITION 4.2 

We first observe that if (aj)jg/ and (fei)ie/ are two bounded families of 
real numbers, 

supoj — sup6j < sup I Qi — sup6j J < sup(aj — hi), 
i&i jei i£i V je/ / iei 

and Isupjgj-aj — sup j^jbj\ < sup^gj- |aj — bi\. Then since the function m i— > 
xV m is 1-Lipschitzian, 

\Zs{m) — Zs{m') \ < \m — m'\. 

So we can define the regular random field {Zt{m);m E Q) and make a con- 
tinuous extension in m from Q into JR. 

The next step is to replace m by an J^s random variable, bounded by 
below, and then to show that we still have 

Zr(As) = esssupE[Z^ VAsIJ^t], TeTs(; a.s. 

T>T 
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First observe that the main properties of {Zs{m))s<^% ^ come from the fact 
that, for any stopping time T > S, the family {E[Zt- V m|^s];T > T} is 
filtering nondecr easing. In particular, 

(A.l) B[ZT{m)\J='s]= ess snpElZrVmlTs] a.s. 

Now for any step random variable = Sl^.mj, with (Ai) an J^^-measurable 
partition of $7, let us define 

Zt(As) =esssupE[Z^ VAsIJ^t], TeTsr a.s. 

T>T 

In order to use property (A.l), we define a new stopping time that 
equals S on Ai and C on A^. It comes that 

1aM^s) = 1aMZsaS^s)\:Fs] 

= 1a, esssup{lA,E[Z, V mi\Ts] + 1a-E[Z^ V As\Ts]} 

= 1a, esssup{E[Z^ VA5I.F5] 

T>S 

+ UMiZr Vmi-Z^y rni)\Ts]} 

= l^^E[Z^Vmi|J-s] 

+ 1a^ esssup{E[(Z, V - E[Z^ V mi\J^r])\:Fs]} 

= lyi, esssupE[Z^ VmilJF^] = 1^^^5(771^) a.s. 

This means that Zs{A.s) = Zs{rni) on Ai, and, therefore, ^^(A^) = Sl^^ x 
Zs{n^i) = Zsi-^s)- The same argument may be applied at any stopping time 
T > 5" to obtain that Zt{A.s) = Zt{A.s) = esssup^>j^E[ZT- y As\J-'t], for any 
T € Tg ;^. Thanks to the Lipschitz property, this formula can be extended by 
continuity to any ^5-measurable random variable bounded by below. 
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